Max level shown:
12024-11-15T21:45:01.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 17813df9-6df7-45d4-8b56-f741992e327e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
22024-11-15T21:45:01.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 17813df9-6df7-45d4-8b56-f741992e327e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
32024-11-15T21:45:01.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 17813df9-6df7-45d4-8b56-f741992e327e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
42024-11-15T21:45:02.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d2c6cadd-477c-4ada-a213-e5d59b30d26f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52024-11-15T21:45:02.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d2c6cadd-477c-4ada-a213-e5d59b30d26f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62024-11-15T21:45:02.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d2c6cadd-477c-4ada-a213-e5d59b30d26f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
72024-11-15T21:45:03.018ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
82024-11-15T21:45:03.018ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
92024-11-15T21:45:03.018ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102024-11-15T21:45:03.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112024-11-15T21:45:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122024-11-15T21:45:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132024-11-15T21:45:03.020ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142024-11-15T21:45:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
152024-11-15T21:45:03.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
162024-11-15T21:45:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
172024-11-15T21:45:03.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
182024-11-15T21:45:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192024-11-15T21:45:03.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
202024-11-15T21:45:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
212024-11-15T21:45:03.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
222024-11-15T21:45:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
232024-11-15T21:45:03.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
242024-11-15T21:45:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
252024-11-15T21:45:03.038ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
262024-11-15T21:45:03.038ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.425603ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
272024-11-15T21:45:03.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.421467ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
282024-11-15T21:45:03.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6cf06d6-d022-49b1-ae98-dc3320d18804 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
292024-11-15T21:45:03.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6cf06d6-d022-49b1-ae98-dc3320d18804 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
302024-11-15T21:45:03.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6cf06d6-d022-49b1-ae98-dc3320d18804 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
312024-11-15T21:45:04.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1ca0d747-de35-4abf-9542-54e888e50934 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
322024-11-15T21:45:04.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1ca0d747-de35-4abf-9542-54e888e50934 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
332024-11-15T21:45:04.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1ca0d747-de35-4abf-9542-54e888e50934 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
342024-11-15T21:45:05.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2556be1e-d59b-4f13-b3b5-ae38eff95b9f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
352024-11-15T21:45:05.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2556be1e-d59b-4f13-b3b5-ae38eff95b9f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
362024-11-15T21:45:05.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2556be1e-d59b-4f13-b3b5-ae38eff95b9f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
372024-11-15T21:45:06.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 21c4155a-a9c8-4349-a67c-2fdcc4305d31 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
382024-11-15T21:45:06.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 21c4155a-a9c8-4349-a67c-2fdcc4305d31 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
392024-11-15T21:45:06.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 21c4155a-a9c8-4349-a67c-2fdcc4305d31 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
402024-11-15T21:45:07.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14039a41-b2be-44ec-8b24-d6010f859a94 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
412024-11-15T21:45:07.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14039a41-b2be-44ec-8b24-d6010f859a94 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
422024-11-15T21:45:07.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14039a41-b2be-44ec-8b24-d6010f859a94 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
432024-11-15T21:45:08.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cf119a9e-f440-4808-94c0-cd9e4336b65a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
442024-11-15T21:45:08.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cf119a9e-f440-4808-94c0-cd9e4336b65a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
452024-11-15T21:45:08.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cf119a9e-f440-4808-94c0-cd9e4336b65a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
462024-11-15T21:45:08.658ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63007
472024-11-15T21:45:08.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63007 req_id = 8fb76173-f297-4b6a-b17d-d477bea091e7 roles = RoleSet { roles: {} } uri = /metrics/producers
482024-11-15T21:45:08.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63007 req_id = 8fb76173-f297-4b6a-b17d-d477bea091e7 resource = Database result = Ok(()) uri = /metrics/producers
492024-11-15T21:45:08.697ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 5e8fa613-d1c4-416c-8557-742a109ff40b
502024-11-15T21:45:08.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38578 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63007 req_id = 8fb76173-f297-4b6a-b17d-d477bea091e7 response_code = 201 uri = /metrics/producers
512024-11-15T21:45:09.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ef71f3bb-7168-402a-b78c-8d8121328e4d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
522024-11-15T21:45:09.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ef71f3bb-7168-402a-b78c-8d8121328e4d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
532024-11-15T21:45:09.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ef71f3bb-7168-402a-b78c-8d8121328e4d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
542024-11-15T21:45:10.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 742c2257-1c3d-418f-81a5-6e2374319702 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
552024-11-15T21:45:10.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 742c2257-1c3d-418f-81a5-6e2374319702 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
562024-11-15T21:45:10.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 742c2257-1c3d-418f-81a5-6e2374319702 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
572024-11-15T21:45:11.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 891f2a7e-8703-477d-b92a-64c86a00bebf roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
582024-11-15T21:45:11.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 891f2a7e-8703-477d-b92a-64c86a00bebf resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
592024-11-15T21:45:11.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 891f2a7e-8703-477d-b92a-64c86a00bebf response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
602024-11-15T21:45:12.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 225ea826-f1b3-4c5a-890f-0fdb7498ca16 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
612024-11-15T21:45:12.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 225ea826-f1b3-4c5a-890f-0fdb7498ca16 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
622024-11-15T21:45:12.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 225ea826-f1b3-4c5a-890f-0fdb7498ca16 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
632024-11-15T21:45:13.018ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
642024-11-15T21:45:13.018ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
652024-11-15T21:45:13.018ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
662024-11-15T21:45:13.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
672024-11-15T21:45:13.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
682024-11-15T21:45:13.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
692024-11-15T21:45:13.020ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
702024-11-15T21:45:13.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
712024-11-15T21:45:13.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
722024-11-15T21:45:13.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
732024-11-15T21:45:13.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
742024-11-15T21:45:13.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
752024-11-15T21:45:13.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
762024-11-15T21:45:13.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
772024-11-15T21:45:13.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
782024-11-15T21:45:13.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
792024-11-15T21:45:13.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
802024-11-15T21:45:13.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
812024-11-15T21:45:13.042ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
822024-11-15T21:45:13.042ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.631863ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
832024-11-15T21:45:13.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.373797ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
842024-11-15T21:45:13.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0b176a6f-21f3-4957-9f2b-63dc24118311 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
852024-11-15T21:45:13.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0b176a6f-21f3-4957-9f2b-63dc24118311 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
862024-11-15T21:45:13.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0b176a6f-21f3-4957-9f2b-63dc24118311 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
872024-11-15T21:45:14.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2aa986cc-ea5f-4361-8571-69656c928c3a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
882024-11-15T21:45:14.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2aa986cc-ea5f-4361-8571-69656c928c3a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
892024-11-15T21:45:14.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2aa986cc-ea5f-4361-8571-69656c928c3a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
902024-11-15T21:45:15.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 27afe998-aefb-427b-8b61-7b5110e3ce5c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
912024-11-15T21:45:15.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 27afe998-aefb-427b-8b61-7b5110e3ce5c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
922024-11-15T21:45:15.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 27afe998-aefb-427b-8b61-7b5110e3ce5c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
932024-11-15T21:45:15.659ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 5d3214af-53c8-4a41-a957-5976acb90fdd response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
942024-11-15T21:45:16.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5f6e7eca-616a-4834-a49e-2308eb1223ad roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
952024-11-15T21:45:16.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5f6e7eca-616a-4834-a49e-2308eb1223ad resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
962024-11-15T21:45:16.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5f6e7eca-616a-4834-a49e-2308eb1223ad response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
972024-11-15T21:45:16.742ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:49033
982024-11-15T21:45:16.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49033 req_id = efcec305-1795-4a2f-9e0a-b77dc48f4164 roles = RoleSet { roles: {} } uri = /metrics/producers
992024-11-15T21:45:16.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49033 req_id = efcec305-1795-4a2f-9e0a-b77dc48f4164 resource = Database result = Ok(()) uri = /metrics/producers
1002024-11-15T21:45:16.767ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 78d47478-5af8-488d-89c5-11be23443b63
1012024-11-15T21:45:16.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24730 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49033 req_id = efcec305-1795-4a2f-9e0a-b77dc48f4164 response_code = 201 uri = /metrics/producers
1022024-11-15T21:45:17.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c350b5bc-c5d0-40f0-a4bf-e6cd014111be roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1032024-11-15T21:45:17.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c350b5bc-c5d0-40f0-a4bf-e6cd014111be resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1042024-11-15T21:45:17.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c350b5bc-c5d0-40f0-a4bf-e6cd014111be response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1052024-11-15T21:45:18.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8282b1cb-c635-4b86-b834-932fb5f9d4dc roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1062024-11-15T21:45:18.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8282b1cb-c635-4b86-b834-932fb5f9d4dc resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1072024-11-15T21:45:18.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8282b1cb-c635-4b86-b834-932fb5f9d4dc response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1082024-11-15T21:45:19.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 437d8a24-a8e6-4d6c-9a4b-f402c3f0dd7a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1092024-11-15T21:45:19.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 437d8a24-a8e6-4d6c-9a4b-f402c3f0dd7a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1102024-11-15T21:45:19.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 437d8a24-a8e6-4d6c-9a4b-f402c3f0dd7a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1112024-11-15T21:45:20.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4cef615b-6054-4d5a-bc48-97fb7aa7d6db roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1122024-11-15T21:45:20.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4cef615b-6054-4d5a-bc48-97fb7aa7d6db resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1132024-11-15T21:45:20.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4cef615b-6054-4d5a-bc48-97fb7aa7d6db response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1142024-11-15T21:45:21.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cd4204f3-d03a-480f-8f26-6ab96b64fd19 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1152024-11-15T21:45:21.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cd4204f3-d03a-480f-8f26-6ab96b64fd19 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1162024-11-15T21:45:21.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cd4204f3-d03a-480f-8f26-6ab96b64fd19 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1172024-11-15T21:45:22.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 532ce3aa-80a3-4aee-ab74-c8247e40a8ab roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1182024-11-15T21:45:22.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 532ce3aa-80a3-4aee-ab74-c8247e40a8ab resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1192024-11-15T21:45:22.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 532ce3aa-80a3-4aee-ab74-c8247e40a8ab response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
1202024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
1212024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1222024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1232024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
1242024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
1252024-11-15T21:45:23.018ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
1262024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
1272024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.62\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
1282024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
1292024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
1302024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1312024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1322024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1332024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
1342024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1352024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1362024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
1372024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1382024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
1392024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
1402024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
1412024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1422024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
1432024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
1442024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1452024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1462024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
1472024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
1482024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
1492024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1502024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
1512024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1522024-11-15T21:45:23.018ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:35:23.018541160 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1532024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
1542024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1552024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1562024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
1572024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
1582024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1592024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
1602024-11-15T21:45:23.018ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1612024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1622024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
1632024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1642024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1652024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
1662024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
1672024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1682024-11-15T21:45:23.018ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1692024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1702024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
1712024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1722024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
1732024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1742024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
1752024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1762024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1772024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
1782024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1792024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
1802024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
1812024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1822024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
1832024-11-15T21:45:23.018ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1842024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1852024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1862024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1872024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1882024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1892024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1902024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1912024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1922024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1932024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1942024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1952024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1962024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1972024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1982024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1992024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2002024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
2012024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2022024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2032024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2042024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2052024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2062024-11-15T21:45:23.019ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 973676276 } })
2072024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2082024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2092024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2102024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2112024-11-15T21:45:23.019ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 973828217 } })
2122024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2132024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2142024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2152024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2162024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
2172024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.373889ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
2182024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2192024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2202024-11-15T21:45:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2212024-11-15T21:45:23.020ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
2222024-11-15T21:45:23.020ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.52468ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
2232024-11-15T21:45:23.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2242024-11-15T21:45:23.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2252024-11-15T21:45:23.022ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.179787ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2262024-11-15T21:45:23.023ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 977855943 } })
2272024-11-15T21:45:23.023ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
2282024-11-15T21:45:23.025ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2292024-11-15T21:45:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2302024-11-15T21:45:23.025ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.156556ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
2312024-11-15T21:45:23.025ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322024-11-15T21:45:23.026ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 981291146 } })
2332024-11-15T21:45:23.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
2342024-11-15T21:45:23.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2352024-11-15T21:45:23.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2362024-11-15T21:45:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2372024-11-15T21:45:23.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2382024-11-15T21:45:23.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2392024-11-15T21:45:23.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2402024-11-15T21:45:23.030ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2412024-11-15T21:45:23.031ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2422024-11-15T21:45:23.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2432024-11-15T21:45:23.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2442024-11-15T21:45:23.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2452024-11-15T21:45:23.034ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2462024-11-15T21:45:23.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2472024-11-15T21:45:23.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2482024-11-15T21:45:23.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2492024-11-15T21:45:23.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2502024-11-15T21:45:23.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2512024-11-15T21:45:23.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2522024-11-15T21:45:23.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2532024-11-15T21:45:23.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2542024-11-15T21:45:23.037ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:35:23.018541160 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2552024-11-15T21:45:23.037ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.688041ms iteration = 4 status = {"expiration":"2024-11-15T21:35:23.018541160Z","pruned":[]}
2562024-11-15T21:45:23.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2572024-11-15T21:45:23.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2582024-11-15T21:45:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2592024-11-15T21:45:23.043ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2602024-11-15T21:45:23.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2612024-11-15T21:45:23.045ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2622024-11-15T21:45:23.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2632024-11-15T21:45:23.045ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2642024-11-15T21:45:23.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2652024-11-15T21:45:23.048ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2662024-11-15T21:45:23.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2672024-11-15T21:45:23.049ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2682024-11-15T21:45:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2692024-11-15T21:45:23.052ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2702024-11-15T21:45:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2712024-11-15T21:45:23.056ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2722024-11-15T21:45:23.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2732024-11-15T21:45:23.058ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1205, tv_nsec: 12573939 } })
2742024-11-15T21:45:23.058ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
2752024-11-15T21:45:23.074ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2762024-11-15T21:45:23.074ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2772024-11-15T21:45:23.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2782024-11-15T21:45:23.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2792024-11-15T21:45:23.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2802024-11-15T21:45:23.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2812024-11-15T21:45:23.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.35976ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
2822024-11-15T21:45:23.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2832024-11-15T21:45:23.088ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2842024-11-15T21:45:23.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2852024-11-15T21:45:23.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2862024-11-15T21:45:23.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2872024-11-15T21:45:23.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2882024-11-15T21:45:23.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2892024-11-15T21:45:23.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2902024-11-15T21:45:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2912024-11-15T21:45:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2922024-11-15T21:45:23.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2932024-11-15T21:45:23.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2942024-11-15T21:45:23.098ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2952024-11-15T21:45:23.098ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2962024-11-15T21:45:23.099ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2972024-11-15T21:45:23.099ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2982024-11-15T21:45:23.099ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.030486ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2992024-11-15T21:45:23.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3002024-11-15T21:45:23.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3012024-11-15T21:45:23.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3022024-11-15T21:45:23.101ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3032024-11-15T21:45:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3042024-11-15T21:45:23.102ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3052024-11-15T21:45:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3062024-11-15T21:45:23.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3072024-11-15T21:45:23.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3082024-11-15T21:45:23.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.033349ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
3092024-11-15T21:45:23.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3102024-11-15T21:45:23.104ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3112024-11-15T21:45:23.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3122024-11-15T21:45:23.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3132024-11-15T21:45:23.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3142024-11-15T21:45:23.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3152024-11-15T21:45:23.107ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3162024-11-15T21:45:23.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3172024-11-15T21:45:23.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3182024-11-15T21:45:23.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
3192024-11-15T21:45:23.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3202024-11-15T21:45:23.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3212024-11-15T21:45:23.110ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3222024-11-15T21:45:23.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3232024-11-15T21:45:23.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3242024-11-15T21:45:23.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.596364ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3252024-11-15T21:45:23.113ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3262024-11-15T21:45:23.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3272024-11-15T21:45:23.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3282024-11-15T21:45:23.114ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3292024-11-15T21:45:23.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3302024-11-15T21:45:23.114ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 96.042843ms iteration = 3 status = {"nsuccess":5}
3312024-11-15T21:45:23.115ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.592567ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3322024-11-15T21:45:23.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3332024-11-15T21:45:23.118ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3342024-11-15T21:45:23.118ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3352024-11-15T21:45:23.118ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 100.08338ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3362024-11-15T21:45:23.119ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3372024-11-15T21:45:23.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3382024-11-15T21:45:23.126ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
3392024-11-15T21:45:23.126ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.84494ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
3402024-11-15T21:45:23.127ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3412024-11-15T21:45:23.127ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 108.420813ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3422024-11-15T21:45:23.136ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3432024-11-15T21:45:23.136ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3442024-11-15T21:45:23.136ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3452024-11-15T21:45:23.136ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3462024-11-15T21:45:23.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3472024-11-15T21:45:23.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3482024-11-15T21:45:23.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3492024-11-15T21:45:23.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3502024-11-15T21:45:23.139ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3512024-11-15T21:45:23.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3522024-11-15T21:45:23.140ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3532024-11-15T21:45:23.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3542024-11-15T21:45:23.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3552024-11-15T21:45:23.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3562024-11-15T21:45:23.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3572024-11-15T21:45:23.144ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3582024-11-15T21:45:23.146ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3592024-11-15T21:45:23.146ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3602024-11-15T21:45:23.146ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3612024-11-15T21:45:23.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3622024-11-15T21:45:23.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
3632024-11-15T21:45:23.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3642024-11-15T21:45:23.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3652024-11-15T21:45:23.150ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 132.145008ms iteration = 7 status = 0
3662024-11-15T21:45:23.152ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3672024-11-15T21:45:23.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3682024-11-15T21:45:23.158ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3692024-11-15T21:45:23.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 139.968938ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3702024-11-15T21:45:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3712024-11-15T21:45:23.160ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3722024-11-15T21:45:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3732024-11-15T21:45:23.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 142.763397ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3742024-11-15T21:45:23.167ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3752024-11-15T21:45:23.167ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3762024-11-15T21:45:23.167ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3772024-11-15T21:45:23.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3782024-11-15T21:45:23.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3792024-11-15T21:45:23.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3802024-11-15T21:45:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3812024-11-15T21:45:23.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3822024-11-15T21:45:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3832024-11-15T21:45:23.174ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
3842024-11-15T21:45:23.174ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3852024-11-15T21:45:23.175ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e13aca1-e52e-4a8c-b32e-23516bef2117", "content-length": "26", "date": "Fri, 15 Nov 2024 21:45:22 GMT"} })
3862024-11-15T21:45:23.175ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3872024-11-15T21:45:23.177ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3882024-11-15T21:45:23.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3892024-11-15T21:45:23.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3902024-11-15T21:45:23.181ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3912024-11-15T21:45:23.190ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3922024-11-15T21:45:23.190ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
3932024-11-15T21:45:23.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3942024-11-15T21:45:23.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3952024-11-15T21:45:23.191ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3962024-11-15T21:45:23.191ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3972024-11-15T21:45:23.191ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 173.587437ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3982024-11-15T21:45:23.195ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3992024-11-15T21:45:23.196ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4002024-11-15T21:45:23.198ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4012024-11-15T21:45:23.198ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4022024-11-15T21:45:23.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4032024-11-15T21:45:23.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4042024-11-15T21:45:23.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4052024-11-15T21:45:23.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4062024-11-15T21:45:23.201ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
4072024-11-15T21:45:23.201ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4082024-11-15T21:45:23.201ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
4092024-11-15T21:45:23.201ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 182.998518ms iteration = 5 status = {"generation":2}
4102024-11-15T21:45:23.222ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
4112024-11-15T21:45:23.222ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
4122024-11-15T21:45:23.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4132024-11-15T21:45:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4142024-11-15T21:45:23.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4152024-11-15T21:45:23.224ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
4162024-11-15T21:45:23.224ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4172024-11-15T21:45:23.225ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80a66a9a-4c40-45b4-b994-99657bb3c899", "content-length": "26", "date": "Fri, 15 Nov 2024 21:45:22 GMT"} })
4182024-11-15T21:45:23.225ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4192024-11-15T21:45:23.227ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
4202024-11-15T21:45:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4212024-11-15T21:45:23.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4222024-11-15T21:45:23.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4232024-11-15T21:45:23.246ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4242024-11-15T21:45:23.246ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 227.989279ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4252024-11-15T21:45:23.268ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 250.304044ms iteration = 10 status = {"physical_disks_added":0}
4262024-11-15T21:45:23.285ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4272024-11-15T21:45:23.295ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
4282024-11-15T21:45:23.295ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 277.358401ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4292024-11-15T21:45:23.322ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
4302024-11-15T21:45:23.322ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4312024-11-15T21:45:23.322ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a355440b-3e03-4e33-afbd-91551acde262", "content-length": "26", "date": "Fri, 15 Nov 2024 21:45:22 GMT"} })
4322024-11-15T21:45:23.322ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4332024-11-15T21:45:23.324ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4342024-11-15T21:45:23.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4352024-11-15T21:45:23.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4362024-11-15T21:45:23.345ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4372024-11-15T21:45:23.345ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "63a69a76-30b4-4c79-af5c-581fa47dfc80", "content-length": "1", "date": "Fri, 15 Nov 2024 21:45:22 GMT"} })
4382024-11-15T21:45:23.346ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4392024-11-15T21:45:23.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4402024-11-15T21:45:23.358ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4412024-11-15T21:45:23.359ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7ef56b8c-233e-424b-b373-a23a8880352f", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4422024-11-15T21:45:23.359ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4432024-11-15T21:45:23.360ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cca554af-2ac1-4944-915f-8a0a73c3ccae", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4442024-11-15T21:45:23.360ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4452024-11-15T21:45:23.362ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4462024-11-15T21:45:23.362ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 344.106473ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4472024-11-15T21:45:23.440ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4482024-11-15T21:45:23.440ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4492024-11-15T21:45:23.441ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4502024-11-15T21:45:23.442ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "33ad1e4f-c51d-43f2-8999-c85b1b66989b", "content-length": "372", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} })
4512024-11-15T21:45:23.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4522024-11-15T21:45:23.442ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 424.470516ms iteration = 7 status = null
4532024-11-15T21:45:23.442ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
4542024-11-15T21:45:23.442ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4552024-11-15T21:45:23.442ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
4562024-11-15T21:45:23.442ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 424.579536ms iteration = 5 status = {"generation":1}
4572024-11-15T21:45:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4582024-11-15T21:45:23.456ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 438.272555ms iteration = 7 status = {}
4592024-11-15T21:45:23.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4602024-11-15T21:45:23.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4612024-11-15T21:45:23.471ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4622024-11-15T21:45:23.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4632024-11-15T21:45:23.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4642024-11-15T21:45:23.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4652024-11-15T21:45:23.502ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4662024-11-15T21:45:23.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4672024-11-15T21:45:23.503ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
4682024-11-15T21:45:23.503ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4692024-11-15T21:45:23.503ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7396b93d-6de1-4831-abbe-f226dbdddc33", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} })
4702024-11-15T21:45:23.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4712024-11-15T21:45:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4722024-11-15T21:45:23.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4732024-11-15T21:45:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4742024-11-15T21:45:23.509ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4752024-11-15T21:45:23.509ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2e1d0db8-7d9e-4496-b5fa-6f0b4e9d52bb", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4762024-11-15T21:45:23.509ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4772024-11-15T21:45:23.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4782024-11-15T21:45:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4792024-11-15T21:45:23.511ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ea41f7d5-91a5-4887-af21-dd36cfd0e83c", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4802024-11-15T21:45:23.511ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4812024-11-15T21:45:23.513ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4822024-11-15T21:45:23.513ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4832024-11-15T21:45:23.513ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2c9269e8-f0d9-4556-bbc5-57f660a72ec5", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4842024-11-15T21:45:23.513ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4852024-11-15T21:45:23.513ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6e6fdde8-d380-4407-9f2a-40d69c8b5b52", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} })
4862024-11-15T21:45:23.515ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 496.747065ms iteration = 8 status = {}
4872024-11-15T21:45:23.515ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4882024-11-15T21:45:23.515ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 497.50173ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4892024-11-15T21:45:23.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4902024-11-15T21:45:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4912024-11-15T21:45:23.553ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
4922024-11-15T21:45:23.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4932024-11-15T21:45:23.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4942024-11-15T21:45:23.565ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4952024-11-15T21:45:23.566ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a9ae0f0-99fa-4de0-b989-6b4679ee51d6", "content-length": "134", "date": "Fri, 15 Nov 2024 21:45:22 GMT"} })
4962024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4972024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
4982024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4992024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5002024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5012024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5022024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5032024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5042024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5052024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5062024-11-15T21:45:23.566ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
5072024-11-15T21:45:23.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5082024-11-15T21:45:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5092024-11-15T21:45:23.569ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5102024-11-15T21:45:23.569ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b62a750e-11a5-4b6f-9245-9b83e3de1d01", "content-length": "2", "date": "Fri, 15 Nov 2024 21:45:22 GMT"} })
5112024-11-15T21:45:23.569ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5122024-11-15T21:45:23.569ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f33be3a-1265-411e-846d-427bb676e2b9", "content-length": "52", "date": "Fri, 15 Nov 2024 21:45:22 GMT"} })
5132024-11-15T21:45:23.569ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
5142024-11-15T21:45:23.569ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5152024-11-15T21:45:23.595ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5162024-11-15T21:45:23.657ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bcbe4d37-67d6-489a-bd88-8c60bf5946ab", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} })
5172024-11-15T21:45:23.657ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
5182024-11-15T21:45:23.658ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5192024-11-15T21:45:23.658ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca6f8544-481d-494e-881a-19ab765f444c", "content-length": "691", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} })
5202024-11-15T21:45:23.658ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
5212024-11-15T21:45:23.658ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
5222024-11-15T21:45:23.658ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
5232024-11-15T21:45:23.658ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1548f97f-75ab-417f-addb-a7b8d5580bd7", "content-length": "682", "date": "Fri, 15 Nov 2024 21:45:23 GMT"} })
5242024-11-15T21:45:23.658ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5252024-11-15T21:45:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5262024-11-15T21:45:23.659ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 640.826519ms iteration = 7 status = {}
5272024-11-15T21:45:23.661ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5282024-11-15T21:45:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5292024-11-15T21:45:23.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 745797a3-8696-47e5-9481-a81e451071e8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
5302024-11-15T21:45:23.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 745797a3-8696-47e5-9481-a81e451071e8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
5312024-11-15T21:45:23.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 745797a3-8696-47e5-9481-a81e451071e8 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
5322024-11-15T21:45:23.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9556a6f1-d72e-4dbe-a437-8920cc6fb12e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5332024-11-15T21:45:23.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9556a6f1-d72e-4dbe-a437-8920cc6fb12e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5342024-11-15T21:45:23.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9556a6f1-d72e-4dbe-a437-8920cc6fb12e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5352024-11-15T21:45:23.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5362024-11-15T21:45:23.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5372024-11-15T21:45:23.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5382024-11-15T21:45:23.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5392024-11-15T21:45:23.782ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 764.243169ms iteration = 7 status = {}
5402024-11-15T21:45:24.625ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44857
5412024-11-15T21:45:24.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44857 req_id = 729f1dde-5e4e-4e33-a2aa-ed4bddd99616 roles = RoleSet { roles: {} } uri = /metrics/producers
5422024-11-15T21:45:24.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44857 req_id = 729f1dde-5e4e-4e33-a2aa-ed4bddd99616 resource = Database result = Ok(()) uri = /metrics/producers
5432024-11-15T21:45:24.681ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 17a6b664-61ae-47e8-9c94-fdc7e3f8e300
5442024-11-15T21:45:24.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56461 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44857 req_id = 729f1dde-5e4e-4e33-a2aa-ed4bddd99616 response_code = 201 uri = /metrics/producers
5452024-11-15T21:45:24.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1b71a931-3e9e-49ad-9b63-a4acc0c4065f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5462024-11-15T21:45:24.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1b71a931-3e9e-49ad-9b63-a4acc0c4065f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5472024-11-15T21:45:24.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1b71a931-3e9e-49ad-9b63-a4acc0c4065f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5482024-11-15T21:45:24.811ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46201
5492024-11-15T21:45:24.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46201 req_id = a682d333-af1f-4803-b3e7-f8ea9903071d roles = RoleSet { roles: {} } uri = /metrics/producers
5502024-11-15T21:45:24.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46201 req_id = a682d333-af1f-4803-b3e7-f8ea9903071d resource = Database result = Ok(()) uri = /metrics/producers
5512024-11-15T21:45:24.847ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 1ee9a34a-c3be-49f8-8ccd-8456768402b0
5522024-11-15T21:45:24.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35472 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46201 req_id = a682d333-af1f-4803-b3e7-f8ea9903071d response_code = 201 uri = /metrics/producers
5532024-11-15T21:45:25.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 499a5849-fba7-41bd-ad41-6ec8cd8fabd5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5542024-11-15T21:45:25.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 499a5849-fba7-41bd-ad41-6ec8cd8fabd5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5552024-11-15T21:45:25.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 499a5849-fba7-41bd-ad41-6ec8cd8fabd5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5562024-11-15T21:45:26.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3f77f737-1536-4782-ba98-46568ff972bc roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5572024-11-15T21:45:26.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3f77f737-1536-4782-ba98-46568ff972bc resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5582024-11-15T21:45:26.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3f77f737-1536-4782-ba98-46568ff972bc response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5592024-11-15T21:45:27.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fcf38694-53e2-476d-9f7d-b0c43cf1e5ec roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5602024-11-15T21:45:27.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fcf38694-53e2-476d-9f7d-b0c43cf1e5ec resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5612024-11-15T21:45:27.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fcf38694-53e2-476d-9f7d-b0c43cf1e5ec response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5622024-11-15T21:45:28.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 30ade737-b18f-4450-b233-d7089de42cc5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5632024-11-15T21:45:28.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 30ade737-b18f-4450-b233-d7089de42cc5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5642024-11-15T21:45:28.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 30ade737-b18f-4450-b233-d7089de42cc5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5652024-11-15T21:45:29.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 150a7073-6ccf-410e-9b85-c2bdbac80f9d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5662024-11-15T21:45:29.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 150a7073-6ccf-410e-9b85-c2bdbac80f9d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5672024-11-15T21:45:29.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 150a7073-6ccf-410e-9b85-c2bdbac80f9d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5682024-11-15T21:45:30.658ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1282 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 0bb6ac28-142d-4b3f-86f8-6f93313c5ebf response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
5692024-11-15T21:45:30.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b7e1b4bc-c666-46d6-b2ee-5bccfb4b288b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5702024-11-15T21:45:30.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b7e1b4bc-c666-46d6-b2ee-5bccfb4b288b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5712024-11-15T21:45:30.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b7e1b4bc-c666-46d6-b2ee-5bccfb4b288b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5722024-11-15T21:45:31.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 49816ba5-1950-48ec-b542-dadaf041b692 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5732024-11-15T21:45:31.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 49816ba5-1950-48ec-b542-dadaf041b692 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5742024-11-15T21:45:31.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 49816ba5-1950-48ec-b542-dadaf041b692 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5752024-11-15T21:45:32.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8b107b92-1dce-44de-a9a9-61828ce147d2 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5762024-11-15T21:45:32.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8b107b92-1dce-44de-a9a9-61828ce147d2 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5772024-11-15T21:45:32.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8b107b92-1dce-44de-a9a9-61828ce147d2 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
5782024-11-15T21:45:33.018ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
5792024-11-15T21:45:33.019ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
5802024-11-15T21:45:33.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5812024-11-15T21:45:33.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5822024-11-15T21:45:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5832024-11-15T21:45:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5842024-11-15T21:45:33.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5852024-11-15T21:45:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5862024-11-15T21:45:33.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5872024-11-15T21:45:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5882024-11-15T21:45:33.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5892024-11-15T21:45:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5902024-11-15T21:45:33.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5912024-11-15T21:45:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
5922024-11-15T21:45:33.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5932024-11-15T21:45:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5942024-11-15T21:45:33.040ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
5952024-11-15T21:45:33.040ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.844651ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
5962024-11-15T21:45:33.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5972024-11-15T21:45:33.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5982024-11-15T21:45:33.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.704119ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5992024-11-15T21:45:33.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9ad63ac0-2960-4be9-b512-054a7626e9ec roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6002024-11-15T21:45:33.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9ad63ac0-2960-4be9-b512-054a7626e9ec resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6012024-11-15T21:45:33.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9ad63ac0-2960-4be9-b512-054a7626e9ec response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6022024-11-15T21:45:34.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b756597e-922c-4765-9f71-0591a2b45e51 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6032024-11-15T21:45:34.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b756597e-922c-4765-9f71-0591a2b45e51 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6042024-11-15T21:45:34.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b756597e-922c-4765-9f71-0591a2b45e51 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6052024-11-15T21:45:36.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f19a3217-6403-4be9-9139-fa6341c820b8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6062024-11-15T21:45:36.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f19a3217-6403-4be9-9139-fa6341c820b8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6072024-11-15T21:45:36.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f19a3217-6403-4be9-9139-fa6341c820b8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6082024-11-15T21:45:37.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 02110755-11ad-49ec-9ef6-cf59ea53f913 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6092024-11-15T21:45:37.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 02110755-11ad-49ec-9ef6-cf59ea53f913 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6102024-11-15T21:45:37.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 02110755-11ad-49ec-9ef6-cf59ea53f913 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6112024-11-15T21:45:38.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0a79a78-7c87-4c31-8b74-13bdb3c92907 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6122024-11-15T21:45:38.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0a79a78-7c87-4c31-8b74-13bdb3c92907 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6132024-11-15T21:45:38.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0a79a78-7c87-4c31-8b74-13bdb3c92907 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6142024-11-15T21:45:39.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 43a0947f-82a6-4f31-978f-141d7bfe96ee roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6152024-11-15T21:45:39.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 43a0947f-82a6-4f31-978f-141d7bfe96ee resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6162024-11-15T21:45:39.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 43a0947f-82a6-4f31-978f-141d7bfe96ee response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6172024-11-15T21:45:40.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d268008-21b1-4dd4-b719-01f1b2728c94 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6182024-11-15T21:45:40.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d268008-21b1-4dd4-b719-01f1b2728c94 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6192024-11-15T21:45:40.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d268008-21b1-4dd4-b719-01f1b2728c94 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6202024-11-15T21:45:41.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0662d0d0-9808-4d12-a8aa-620835c89c7f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6212024-11-15T21:45:41.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0662d0d0-9808-4d12-a8aa-620835c89c7f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6222024-11-15T21:45:41.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0662d0d0-9808-4d12-a8aa-620835c89c7f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6232024-11-15T21:45:42.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ea9cf116-5234-4b58-b757-71b36d96c621 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6242024-11-15T21:45:42.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ea9cf116-5234-4b58-b757-71b36d96c621 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6252024-11-15T21:45:42.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ea9cf116-5234-4b58-b757-71b36d96c621 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6262024-11-15T21:45:43.019ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
6272024-11-15T21:45:43.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6282024-11-15T21:45:43.019ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
6292024-11-15T21:45:43.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6302024-11-15T21:45:43.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6312024-11-15T21:45:43.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6322024-11-15T21:45:43.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6332024-11-15T21:45:43.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6342024-11-15T21:45:43.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6352024-11-15T21:45:43.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6362024-11-15T21:45:43.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6372024-11-15T21:45:43.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6382024-11-15T21:45:43.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6392024-11-15T21:45:43.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6402024-11-15T21:45:43.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6412024-11-15T21:45:43.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
6422024-11-15T21:45:43.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6432024-11-15T21:45:43.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6442024-11-15T21:45:43.070ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
6452024-11-15T21:45:43.070ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.94253ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
6462024-11-15T21:45:43.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.899591ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6472024-11-15T21:45:43.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 655f03bf-655b-4595-8d44-811cb54cff93 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6482024-11-15T21:45:43.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 655f03bf-655b-4595-8d44-811cb54cff93 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6492024-11-15T21:45:43.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 655f03bf-655b-4595-8d44-811cb54cff93 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6502024-11-15T21:45:44.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2cc5a0f8-7e09-4df8-8a82-02c73b65b76c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6512024-11-15T21:45:44.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2cc5a0f8-7e09-4df8-8a82-02c73b65b76c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6522024-11-15T21:45:44.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2cc5a0f8-7e09-4df8-8a82-02c73b65b76c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6532024-11-15T21:45:45.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0e20c783-5a24-4ebe-8f1a-3c68fbf6f947 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6542024-11-15T21:45:45.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0e20c783-5a24-4ebe-8f1a-3c68fbf6f947 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6552024-11-15T21:45:45.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0e20c783-5a24-4ebe-8f1a-3c68fbf6f947 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6562024-11-15T21:45:45.274ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:39922
6572024-11-15T21:45:45.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39922 req_id = 952f0868-af6d-4a6d-8d0a-ebf3c330ca4e roles = RoleSet { roles: {} } uri = /metrics/producers
6582024-11-15T21:45:45.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39922 req_id = 952f0868-af6d-4a6d-8d0a-ebf3c330ca4e resource = Database result = Ok(()) uri = /metrics/producers
6592024-11-15T21:45:45.405ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 97598fa2-4ef4-4fda-9111-75c99f8284f6
6602024-11-15T21:45:45.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130968 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39922 req_id = 952f0868-af6d-4a6d-8d0a-ebf3c330ca4e response_code = 201 uri = /metrics/producers
6612024-11-15T21:45:45.661ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1223 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 59873bfa-6c52-46f6-8f8b-e386ba6ac999 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
6622024-11-15T21:45:46.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 50bc3985-1aca-4573-b104-79d0e457a71e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6632024-11-15T21:45:46.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 50bc3985-1aca-4573-b104-79d0e457a71e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6642024-11-15T21:45:46.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 50bc3985-1aca-4573-b104-79d0e457a71e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6652024-11-15T21:45:47.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b40e9125-a45a-4ceb-b4d9-8d6a02e401b9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6662024-11-15T21:45:47.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b40e9125-a45a-4ceb-b4d9-8d6a02e401b9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6672024-11-15T21:45:47.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b40e9125-a45a-4ceb-b4d9-8d6a02e401b9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6682024-11-15T21:45:48.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = df481e7e-ba1a-4c8d-a2ae-93e37c41653a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6692024-11-15T21:45:48.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = df481e7e-ba1a-4c8d-a2ae-93e37c41653a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6702024-11-15T21:45:48.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = df481e7e-ba1a-4c8d-a2ae-93e37c41653a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6712024-11-15T21:45:49.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cfb374b2-d00a-4d28-b022-0577c45caec6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6722024-11-15T21:45:49.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cfb374b2-d00a-4d28-b022-0577c45caec6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6732024-11-15T21:45:49.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cfb374b2-d00a-4d28-b022-0577c45caec6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6742024-11-15T21:45:50.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 37e8ebfe-3059-4c3e-a7ee-3cc1f8d077c6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6752024-11-15T21:45:50.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 37e8ebfe-3059-4c3e-a7ee-3cc1f8d077c6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6762024-11-15T21:45:50.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 37e8ebfe-3059-4c3e-a7ee-3cc1f8d077c6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6772024-11-15T21:45:50.652ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:40566
6782024-11-15T21:45:50.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = aacbcc07-786a-4596-b664-98b0735d5023 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
6792024-11-15T21:45:50.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = aacbcc07-786a-4596-b664-98b0735d5023 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
6802024-11-15T21:45:50.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = aacbcc07-786a-4596-b664-98b0735d5023 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
6812024-11-15T21:45:50.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 2a2d487f-e926-4d0a-bbcf-7b6a831741c4 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
6822024-11-15T21:45:50.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 2a2d487f-e926-4d0a-bbcf-7b6a831741c4 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
6832024-11-15T21:45:50.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 2a2d487f-e926-4d0a-bbcf-7b6a831741c4 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
6842024-11-15T21:45:51.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 81168454-270b-4d63-b409-8e8b260031a1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6852024-11-15T21:45:51.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 81168454-270b-4d63-b409-8e8b260031a1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6862024-11-15T21:45:51.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 81168454-270b-4d63-b409-8e8b260031a1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6872024-11-15T21:45:52.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 90c23b1b-4ee5-4e23-aa18-4e4d0f557dd9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6882024-11-15T21:45:52.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 90c23b1b-4ee5-4e23-aa18-4e4d0f557dd9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6892024-11-15T21:45:52.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 90c23b1b-4ee5-4e23-aa18-4e4d0f557dd9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
6902024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
6912024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
6922024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6932024-11-15T21:45:53.019ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6942024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6952024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
6962024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6972024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
6982024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
6992024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
7002024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7012024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7022024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
7032024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
7042024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
7052024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7062024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7072024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7082024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
7092024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7102024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
7112024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7122024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
7132024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
7142024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7152024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
7162024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7172024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
7182024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7192024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
7202024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7212024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
7222024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7232024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
7242024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7252024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7262024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7272024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7282024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7292024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7302024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7312024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7322024-11-15T21:45:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7332024-11-15T21:45:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7342024-11-15T21:45:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7352024-11-15T21:45:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7362024-11-15T21:45:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7372024-11-15T21:45:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7382024-11-15T21:45:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7392024-11-15T21:45:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7402024-11-15T21:45:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7412024-11-15T21:45:53.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7422024-11-15T21:45:53.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7432024-11-15T21:45:53.023ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 977441207 } })
7442024-11-15T21:45:53.023ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
7452024-11-15T21:45:53.023ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.509109ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7462024-11-15T21:45:53.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7472024-11-15T21:45:53.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7482024-11-15T21:45:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7492024-11-15T21:45:53.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7502024-11-15T21:45:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7512024-11-15T21:45:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7522024-11-15T21:45:53.027ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7532024-11-15T21:45:53.027ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 981849686 } })
7542024-11-15T21:45:53.028ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
7552024-11-15T21:45:53.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7562024-11-15T21:45:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7572024-11-15T21:45:53.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7582024-11-15T21:45:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7592024-11-15T21:45:53.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7602024-11-15T21:45:53.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7612024-11-15T21:45:53.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7622024-11-15T21:45:53.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7632024-11-15T21:45:53.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7642024-11-15T21:45:53.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7652024-11-15T21:45:53.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7662024-11-15T21:45:53.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7672024-11-15T21:45:53.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7682024-11-15T21:45:53.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7692024-11-15T21:45:53.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
7702024-11-15T21:45:53.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7712024-11-15T21:45:53.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7722024-11-15T21:45:53.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7732024-11-15T21:45:53.062ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
7742024-11-15T21:45:53.062ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.20616ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
7752024-11-15T21:45:53.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7762024-11-15T21:45:53.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7772024-11-15T21:45:53.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7782024-11-15T21:45:53.064ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7792024-11-15T21:45:53.064ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7802024-11-15T21:45:53.064ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7812024-11-15T21:45:53.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7822024-11-15T21:45:53.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7832024-11-15T21:45:53.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7842024-11-15T21:45:53.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7852024-11-15T21:45:53.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7862024-11-15T21:45:53.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7872024-11-15T21:45:53.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.020368ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
7882024-11-15T21:45:53.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7892024-11-15T21:45:53.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7902024-11-15T21:45:53.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7912024-11-15T21:45:53.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7922024-11-15T21:45:53.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7932024-11-15T21:45:53.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7942024-11-15T21:45:53.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7952024-11-15T21:45:53.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7962024-11-15T21:45:53.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 26717117 } })
7972024-11-15T21:45:53.073ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
7982024-11-15T21:45:53.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7992024-11-15T21:45:53.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.212581ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
8002024-11-15T21:45:53.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8012024-11-15T21:45:53.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8022024-11-15T21:45:53.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8032024-11-15T21:45:53.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8042024-11-15T21:45:53.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8052024-11-15T21:45:53.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8062024-11-15T21:45:53.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8072024-11-15T21:45:53.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.059614ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8082024-11-15T21:45:53.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
8092024-11-15T21:45:53.076ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8102024-11-15T21:45:53.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8112024-11-15T21:45:53.079ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.737578ms iteration = 8 status = 0
8122024-11-15T21:45:53.082ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8132024-11-15T21:45:53.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8142024-11-15T21:45:53.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8152024-11-15T21:45:53.084ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8162024-11-15T21:45:53.084ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.882521ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8172024-11-15T21:45:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8182024-11-15T21:45:53.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 66.914405ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
8192024-11-15T21:45:53.098ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8202024-11-15T21:45:53.098ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8212024-11-15T21:45:53.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8222024-11-15T21:45:53.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8232024-11-15T21:45:53.098ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
8242024-11-15T21:45:53.098ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8252024-11-15T21:45:53.099ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfb0aeef-0782-4cb9-ab97-fad6db2a82aa", "content-length": "26", "date": "Fri, 15 Nov 2024 21:45:52 GMT"} })
8262024-11-15T21:45:53.099ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8272024-11-15T21:45:53.101ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8282024-11-15T21:45:53.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8292024-11-15T21:45:53.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8302024-11-15T21:45:53.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8312024-11-15T21:45:53.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8322024-11-15T21:45:53.110ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
8332024-11-15T21:45:53.110ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8342024-11-15T21:45:53.110ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d01a7d0f-bf2f-46ce-83f0-e8586b928622", "content-length": "26", "date": "Fri, 15 Nov 2024 21:45:52 GMT"} })
8352024-11-15T21:45:53.110ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8362024-11-15T21:45:53.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.38675ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
8372024-11-15T21:45:53.112ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8382024-11-15T21:45:53.112ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.134275ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8392024-11-15T21:45:53.136ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8402024-11-15T21:45:53.136ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8412024-11-15T21:45:53.136ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.413182ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8422024-11-15T21:45:53.147ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.626898ms iteration = 11 status = {"physical_disks_added":0}
8432024-11-15T21:45:53.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8442024-11-15T21:45:53.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8452024-11-15T21:45:53.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8462024-11-15T21:45:53.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8472024-11-15T21:45:53.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8482024-11-15T21:45:53.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8492024-11-15T21:45:53.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8502024-11-15T21:45:53.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8512024-11-15T21:45:53.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8522024-11-15T21:45:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8532024-11-15T21:45:53.201ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
8542024-11-15T21:45:53.201ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8552024-11-15T21:45:53.202ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12b301cb-0cee-4a5c-a7c7-1711999fc394", "content-length": "26", "date": "Fri, 15 Nov 2024 21:45:52 GMT"} })
8562024-11-15T21:45:53.202ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8572024-11-15T21:45:53.204ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
8582024-11-15T21:45:53.210ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8592024-11-15T21:45:53.210ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8602024-11-15T21:45:53.211ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7a0239a-ca77-47ae-933b-b92e6e27e021", "content-length": "372", "date": "Fri, 15 Nov 2024 21:45:53 GMT"} })
8612024-11-15T21:45:53.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8622024-11-15T21:45:53.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8632024-11-15T21:45:53.267ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8642024-11-15T21:45:53.267ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8652024-11-15T21:45:53.267ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1a2350d6-78c1-46f5-a7c3-b0580bf2f346", "date": "Fri, 15 Nov 2024 21:45:52 GMT"} })
8662024-11-15T21:45:53.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8672024-11-15T21:45:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8682024-11-15T21:45:53.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8692024-11-15T21:45:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8702024-11-15T21:45:53.289ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8712024-11-15T21:45:53.289ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "44d23202-ffab-48a7-ab02-1ac32ce1be3b", "content-length": "691", "date": "Fri, 15 Nov 2024 21:45:52 GMT"} })
8722024-11-15T21:45:53.289ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8732024-11-15T21:45:53.289ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8742024-11-15T21:45:53.289ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8752024-11-15T21:45:53.291ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 271.995285ms iteration = 8 status = {}
8762024-11-15T21:45:53.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8772024-11-15T21:45:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8782024-11-15T21:45:53.297ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8792024-11-15T21:45:53.297ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8802024-11-15T21:45:53.297ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9fa1b2ae-bd5d-475d-95a9-d23b744e2858", "date": "Fri, 15 Nov 2024 21:45:52 GMT"} })
8812024-11-15T21:45:53.299ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.857637ms iteration = 9 status = {}
8822024-11-15T21:45:53.331ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8832024-11-15T21:45:53.331ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2eaee752-e4ca-4285-b022-eedbb9d0416f", "content-length": "1", "date": "Fri, 15 Nov 2024 21:45:53 GMT"} })
8842024-11-15T21:45:53.333ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8852024-11-15T21:45:53.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8862024-11-15T21:45:53.335ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 316.301983ms iteration = 8 status = null
8872024-11-15T21:45:53.337ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 318.314416ms iteration = 8 status = {}
8882024-11-15T21:45:53.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0666151-6ddd-401c-9c30-e7a32914d3c4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
8892024-11-15T21:45:53.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0666151-6ddd-401c-9c30-e7a32914d3c4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
8902024-11-15T21:45:53.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0666151-6ddd-401c-9c30-e7a32914d3c4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
8912024-11-15T21:45:53.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8922024-11-15T21:45:53.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8932024-11-15T21:45:53.391ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
8942024-11-15T21:45:53.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8952024-11-15T21:45:53.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8962024-11-15T21:45:53.400ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8972024-11-15T21:45:53.400ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "deeefb5b-83f0-43a9-aa31-7eeac70a511d", "content-length": "134", "date": "Fri, 15 Nov 2024 21:45:53 GMT"} })
8982024-11-15T21:45:53.400ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8992024-11-15T21:45:53.400ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
9002024-11-15T21:45:53.401ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9012024-11-15T21:45:53.401ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9022024-11-15T21:45:53.401ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9032024-11-15T21:45:53.401ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9042024-11-15T21:45:53.401ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9052024-11-15T21:45:53.401ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9062024-11-15T21:45:53.401ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9072024-11-15T21:45:53.401ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9082024-11-15T21:45:53.401ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
9092024-11-15T21:45:53.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9102024-11-15T21:45:53.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9112024-11-15T21:45:53.403ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9122024-11-15T21:45:53.403ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a84be8e-f2b3-40b9-95f8-7c7b8f37d1f4", "content-length": "2", "date": "Fri, 15 Nov 2024 21:45:53 GMT"} })
9132024-11-15T21:45:53.403ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9142024-11-15T21:45:53.403ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae3a4f4f-3584-4523-9095-9eb6e8ebfe3e", "content-length": "52", "date": "Fri, 15 Nov 2024 21:45:53 GMT"} })
9152024-11-15T21:45:53.403ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
9162024-11-15T21:45:53.403ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9172024-11-15T21:45:53.495ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "66da222f-14c2-4eea-9b7a-f26454f0dd24", "date": "Fri, 15 Nov 2024 21:45:52 GMT"} })
9182024-11-15T21:45:53.496ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
9192024-11-15T21:45:53.496ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9202024-11-15T21:45:53.496ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bddc5dbd-8af5-48da-a82c-7e9fc69e1e0d", "content-length": "682", "date": "Fri, 15 Nov 2024 21:45:52 GMT"} })
9212024-11-15T21:45:53.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9222024-11-15T21:45:53.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9232024-11-15T21:45:53.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9242024-11-15T21:45:53.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9252024-11-15T21:45:53.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9262024-11-15T21:45:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9272024-11-15T21:45:53.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9282024-11-15T21:45:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9292024-11-15T21:45:53.513ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 494.285238ms iteration = 8 status = {}
9302024-11-15T21:45:53.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = aa035b10-e0a7-4de5-a29f-0c909f412800 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
9312024-11-15T21:45:53.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = aa035b10-e0a7-4de5-a29f-0c909f412800 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
9322024-11-15T21:45:53.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = aa035b10-e0a7-4de5-a29f-0c909f412800 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
9332024-11-15T21:45:54.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fded545e-f1e3-4f29-900b-05d8dca0096b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9342024-11-15T21:45:54.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fded545e-f1e3-4f29-900b-05d8dca0096b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9352024-11-15T21:45:54.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fded545e-f1e3-4f29-900b-05d8dca0096b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9362024-11-15T21:45:55.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dc4dba14-b729-482a-90c3-1513f5781998 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9372024-11-15T21:45:55.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dc4dba14-b729-482a-90c3-1513f5781998 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9382024-11-15T21:45:55.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dc4dba14-b729-482a-90c3-1513f5781998 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9392024-11-15T21:45:56.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 449a3c8a-d018-47c7-abd5-3cd8155d52bf roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9402024-11-15T21:45:56.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 449a3c8a-d018-47c7-abd5-3cd8155d52bf resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9412024-11-15T21:45:56.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 449a3c8a-d018-47c7-abd5-3cd8155d52bf response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9422024-11-15T21:45:57.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ea91a919-cdcd-46a3-bf4c-5139d99626d0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9432024-11-15T21:45:57.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ea91a919-cdcd-46a3-bf4c-5139d99626d0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9442024-11-15T21:45:57.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ea91a919-cdcd-46a3-bf4c-5139d99626d0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9452024-11-15T21:45:58.460ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47444
9462024-11-15T21:45:58.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47444 req_id = 086ed424-efb9-4374-8f30-aef537958a16 roles = RoleSet { roles: {} } uri = /metrics/producers
9472024-11-15T21:45:58.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47444 req_id = 086ed424-efb9-4374-8f30-aef537958a16 resource = Database result = Ok(()) uri = /metrics/producers
9482024-11-15T21:45:58.512ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 54270a8d-942f-4159-a4b4-d6745626c749
9492024-11-15T21:45:58.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48455 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47444 req_id = 086ed424-efb9-4374-8f30-aef537958a16 response_code = 201 uri = /metrics/producers
9502024-11-15T21:45:58.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = db6c50a6-af5e-4f41-b5f9-92cd9d52504e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9512024-11-15T21:45:58.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = db6c50a6-af5e-4f41-b5f9-92cd9d52504e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9522024-11-15T21:45:58.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = db6c50a6-af5e-4f41-b5f9-92cd9d52504e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9532024-11-15T21:45:59.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cfa8627b-a82d-4374-8ee5-8ae9a788e14f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9542024-11-15T21:45:59.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cfa8627b-a82d-4374-8ee5-8ae9a788e14f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9552024-11-15T21:45:59.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cfa8627b-a82d-4374-8ee5-8ae9a788e14f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9562024-11-15T21:46:00.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c294e332-df3f-4afc-ade1-777179e90724 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9572024-11-15T21:46:00.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c294e332-df3f-4afc-ade1-777179e90724 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9582024-11-15T21:46:00.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c294e332-df3f-4afc-ade1-777179e90724 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9592024-11-15T21:46:00.661ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1656 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 3d34e6fa-31cd-4b6e-b878-ae06c8a20ebd response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
9602024-11-15T21:46:01.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c3f5bfb2-d86c-4607-957e-b7812a87d182 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9612024-11-15T21:46:01.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c3f5bfb2-d86c-4607-957e-b7812a87d182 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9622024-11-15T21:46:01.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c3f5bfb2-d86c-4607-957e-b7812a87d182 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9632024-11-15T21:46:02.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 938d0ce3-b175-4c9a-94c5-6ddde3d709fe roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9642024-11-15T21:46:02.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 938d0ce3-b175-4c9a-94c5-6ddde3d709fe resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9652024-11-15T21:46:02.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 938d0ce3-b175-4c9a-94c5-6ddde3d709fe response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9662024-11-15T21:46:03.019ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
9672024-11-15T21:46:03.019ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
9682024-11-15T21:46:03.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9692024-11-15T21:46:03.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9702024-11-15T21:46:03.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9712024-11-15T21:46:03.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9722024-11-15T21:46:03.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9732024-11-15T21:46:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9742024-11-15T21:46:03.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9752024-11-15T21:46:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9762024-11-15T21:46:03.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9772024-11-15T21:46:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9782024-11-15T21:46:03.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9792024-11-15T21:46:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
9802024-11-15T21:46:03.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9812024-11-15T21:46:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9822024-11-15T21:46:03.041ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
9832024-11-15T21:46:03.041ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.099544ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
9842024-11-15T21:46:03.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9852024-11-15T21:46:03.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9862024-11-15T21:46:03.077ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.668101ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9872024-11-15T21:46:03.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6cde9d90-7b51-4d69-bc19-a75314d1ee8a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9882024-11-15T21:46:03.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6cde9d90-7b51-4d69-bc19-a75314d1ee8a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9892024-11-15T21:46:03.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6cde9d90-7b51-4d69-bc19-a75314d1ee8a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9902024-11-15T21:46:04.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2a2884b6-a304-46bd-8b3b-82af7397183f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9912024-11-15T21:46:04.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2a2884b6-a304-46bd-8b3b-82af7397183f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9922024-11-15T21:46:04.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2a2884b6-a304-46bd-8b3b-82af7397183f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9932024-11-15T21:46:05.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a069753c-0294-444e-923a-bf64079daf2b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9942024-11-15T21:46:05.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a069753c-0294-444e-923a-bf64079daf2b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9952024-11-15T21:46:05.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a069753c-0294-444e-923a-bf64079daf2b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9962024-11-15T21:46:06.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 947923b3-df74-47eb-9e5c-1c6bef39fb3c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9972024-11-15T21:46:06.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 947923b3-df74-47eb-9e5c-1c6bef39fb3c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9982024-11-15T21:46:06.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 947923b3-df74-47eb-9e5c-1c6bef39fb3c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
9992024-11-15T21:46:07.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a124676b-10b1-4454-b33b-495d0c506202 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10002024-11-15T21:46:07.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a124676b-10b1-4454-b33b-495d0c506202 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10012024-11-15T21:46:07.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a124676b-10b1-4454-b33b-495d0c506202 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10022024-11-15T21:46:08.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a7d5362a-f99a-48b4-a6a1-a60e6a716abb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10032024-11-15T21:46:08.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a7d5362a-f99a-48b4-a6a1-a60e6a716abb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10042024-11-15T21:46:08.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a7d5362a-f99a-48b4-a6a1-a60e6a716abb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10052024-11-15T21:46:09.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 71757837-12ad-434a-9d3f-039b6d6bfd78 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10062024-11-15T21:46:09.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 71757837-12ad-434a-9d3f-039b6d6bfd78 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10072024-11-15T21:46:09.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 71757837-12ad-434a-9d3f-039b6d6bfd78 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10082024-11-15T21:46:10.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ff747f60-3e47-48ae-8480-19acc2d420c6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10092024-11-15T21:46:10.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ff747f60-3e47-48ae-8480-19acc2d420c6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10102024-11-15T21:46:10.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ff747f60-3e47-48ae-8480-19acc2d420c6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10112024-11-15T21:46:11.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b1e1040-b915-4e61-b298-640b6da6187a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10122024-11-15T21:46:11.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b1e1040-b915-4e61-b298-640b6da6187a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10132024-11-15T21:46:11.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b1e1040-b915-4e61-b298-640b6da6187a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10142024-11-15T21:46:12.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ec2b1713-8a86-4835-840f-5b33b7056954 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10152024-11-15T21:46:12.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ec2b1713-8a86-4835-840f-5b33b7056954 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10162024-11-15T21:46:12.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ec2b1713-8a86-4835-840f-5b33b7056954 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10172024-11-15T21:46:13.016ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
10182024-11-15T21:46:13.016ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
10192024-11-15T21:46:13.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10202024-11-15T21:46:13.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10212024-11-15T21:46:13.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10222024-11-15T21:46:13.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10232024-11-15T21:46:13.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10242024-11-15T21:46:13.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10252024-11-15T21:46:13.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10262024-11-15T21:46:13.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10272024-11-15T21:46:13.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10282024-11-15T21:46:13.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10292024-11-15T21:46:13.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10302024-11-15T21:46:13.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10312024-11-15T21:46:13.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10322024-11-15T21:46:13.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
10332024-11-15T21:46:13.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10342024-11-15T21:46:13.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10352024-11-15T21:46:13.065ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
10362024-11-15T21:46:13.065ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.419241ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
10372024-11-15T21:46:13.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.201001ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10382024-11-15T21:46:13.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e157bea0-6dc8-49df-a23d-721143d8b21e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10392024-11-15T21:46:13.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e157bea0-6dc8-49df-a23d-721143d8b21e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10402024-11-15T21:46:13.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e157bea0-6dc8-49df-a23d-721143d8b21e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10412024-11-15T21:46:14.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c7d57a9d-92c6-41b6-8adf-118e2619c090 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10422024-11-15T21:46:14.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c7d57a9d-92c6-41b6-8adf-118e2619c090 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10432024-11-15T21:46:14.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c7d57a9d-92c6-41b6-8adf-118e2619c090 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10442024-11-15T21:46:15.656ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1357 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = e74777a0-9448-4898-baee-186bd58b15a7 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
10452024-11-15T21:46:15.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 50f5faab-8a26-48e6-bddc-7c684b72cb3a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10462024-11-15T21:46:15.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 50f5faab-8a26-48e6-bddc-7c684b72cb3a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10472024-11-15T21:46:15.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 50f5faab-8a26-48e6-bddc-7c684b72cb3a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10482024-11-15T21:46:16.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 48949393-b614-483c-ba3c-9e9c07d269f5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10492024-11-15T21:46:16.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 48949393-b614-483c-ba3c-9e9c07d269f5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10502024-11-15T21:46:16.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 48949393-b614-483c-ba3c-9e9c07d269f5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10512024-11-15T21:46:17.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 75fcb09b-dc61-477d-85b3-c4468cd53dd5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10522024-11-15T21:46:17.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 75fcb09b-dc61-477d-85b3-c4468cd53dd5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10532024-11-15T21:46:18.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 75fcb09b-dc61-477d-85b3-c4468cd53dd5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10542024-11-15T21:46:19.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2c4b14ef-802e-4755-b67a-848b5e680c3f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10552024-11-15T21:46:19.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2c4b14ef-802e-4755-b67a-848b5e680c3f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10562024-11-15T21:46:19.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2c4b14ef-802e-4755-b67a-848b5e680c3f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10572024-11-15T21:46:20.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 93b6f8c2-d7fc-41ba-ad31-41ea1bc93c75 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10582024-11-15T21:46:20.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 93b6f8c2-d7fc-41ba-ad31-41ea1bc93c75 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10592024-11-15T21:46:20.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 93b6f8c2-d7fc-41ba-ad31-41ea1bc93c75 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10602024-11-15T21:46:20.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 88af503d-8ffb-4acd-b66c-306516118ee8 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
10612024-11-15T21:46:20.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 88af503d-8ffb-4acd-b66c-306516118ee8 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
10622024-11-15T21:46:20.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 88af503d-8ffb-4acd-b66c-306516118ee8 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
10632024-11-15T21:46:20.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 6141844c-bc28-4397-aa81-ce5d8dcac21c roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
10642024-11-15T21:46:20.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 6141844c-bc28-4397-aa81-ce5d8dcac21c resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
10652024-11-15T21:46:20.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 6141844c-bc28-4397-aa81-ce5d8dcac21c response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
10662024-11-15T21:46:21.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 11c6bf69-daa2-4036-bafb-78e1c56df629 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10672024-11-15T21:46:21.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 11c6bf69-daa2-4036-bafb-78e1c56df629 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10682024-11-15T21:46:21.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 11c6bf69-daa2-4036-bafb-78e1c56df629 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10692024-11-15T21:46:22.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 10967f40-3c25-4066-bf03-a8a28c9a4b5f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10702024-11-15T21:46:22.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 10967f40-3c25-4066-bf03-a8a28c9a4b5f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10712024-11-15T21:46:22.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 10967f40-3c25-4066-bf03-a8a28c9a4b5f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
10722024-11-15T21:46:23.011ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
10732024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10742024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
10752024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10762024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
10772024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
10782024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10792024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
10802024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
10812024-11-15T21:46:23.012ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10822024-11-15T21:46:23.012ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10832024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
10842024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10852024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10862024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10872024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
10882024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10892024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
10902024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10912024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
10922024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
10932024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10942024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10952024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
10962024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
10972024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10982024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10992024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
11002024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
11012024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11022024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
11032024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
11042024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11052024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
11062024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11072024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
11082024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
11092024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11102024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
11112024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
11122024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
11132024-11-15T21:46:23.012ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:36:23.012324267 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11142024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11152024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
11162024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11172024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
11182024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11192024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
11202024-11-15T21:46:23.012ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
11212024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.48\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
11222024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
11232024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
11242024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
11252024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11262024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11272024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
11282024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
11292024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
11302024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
11312024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11322024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11332024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
11342024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11352024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11362024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
11372024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11382024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11392024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11402024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11412024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11422024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11432024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11442024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11452024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11462024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11472024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11482024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11492024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11502024-11-15T21:46:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11512024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11522024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11532024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11542024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
11552024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11562024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11572024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11582024-11-15T21:46:23.013ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 974597274 } })
11592024-11-15T21:46:23.013ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 974762595 } })
11602024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
11612024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.239439ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
11622024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
11632024-11-15T21:46:23.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.47694ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
11642024-11-15T21:46:23.016ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.130557ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11652024-11-15T21:46:23.016ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.819551ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
11662024-11-15T21:46:23.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11672024-11-15T21:46:23.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11682024-11-15T21:46:23.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11692024-11-15T21:46:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11702024-11-15T21:46:23.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11712024-11-15T21:46:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11722024-11-15T21:46:23.027ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 988576925 } })
11732024-11-15T21:46:23.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
11742024-11-15T21:46:23.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11752024-11-15T21:46:23.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11762024-11-15T21:46:23.029ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:36:23.012324267 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11772024-11-15T21:46:23.029ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.094211ms iteration = 5 status = {"expiration":"2024-11-15T21:36:23.012324267Z","pruned":[]}
11782024-11-15T21:46:23.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11792024-11-15T21:46:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11802024-11-15T21:46:23.032ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 993986190 } })
11812024-11-15T21:46:23.032ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
11822024-11-15T21:46:23.033ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11832024-11-15T21:46:23.033ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11842024-11-15T21:46:23.033ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.199808ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11852024-11-15T21:46:23.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11862024-11-15T21:46:23.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11872024-11-15T21:46:23.038ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11882024-11-15T21:46:23.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11892024-11-15T21:46:23.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11902024-11-15T21:46:23.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11912024-11-15T21:46:23.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.761136ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11922024-11-15T21:46:23.066ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11932024-11-15T21:46:23.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11942024-11-15T21:46:23.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11952024-11-15T21:46:23.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11962024-11-15T21:46:23.072ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11972024-11-15T21:46:23.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11982024-11-15T21:46:23.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11992024-11-15T21:46:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12002024-11-15T21:46:23.075ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12012024-11-15T21:46:23.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12022024-11-15T21:46:23.076ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12032024-11-15T21:46:23.078ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12042024-11-15T21:46:23.078ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12052024-11-15T21:46:23.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12062024-11-15T21:46:23.080ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12072024-11-15T21:46:23.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12082024-11-15T21:46:23.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12092024-11-15T21:46:23.081ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12102024-11-15T21:46:23.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.156999ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
12112024-11-15T21:46:23.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12122024-11-15T21:46:23.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12132024-11-15T21:46:23.081ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12142024-11-15T21:46:23.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12152024-11-15T21:46:23.082ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12162024-11-15T21:46:23.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
12172024-11-15T21:46:23.084ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12182024-11-15T21:46:23.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12192024-11-15T21:46:23.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12202024-11-15T21:46:23.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12212024-11-15T21:46:23.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12222024-11-15T21:46:23.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12232024-11-15T21:46:23.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12242024-11-15T21:46:23.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12252024-11-15T21:46:23.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 85.074572ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
12262024-11-15T21:46:23.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12272024-11-15T21:46:23.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12282024-11-15T21:46:23.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12292024-11-15T21:46:23.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12302024-11-15T21:46:23.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12312024-11-15T21:46:23.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12322024-11-15T21:46:23.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12332024-11-15T21:46:23.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12342024-11-15T21:46:23.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12352024-11-15T21:46:23.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12362024-11-15T21:46:23.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c49da270-ae58-445b-bebc-a2503a0b4ecd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
12372024-11-15T21:46:23.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c49da270-ae58-445b-bebc-a2503a0b4ecd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
12382024-11-15T21:46:23.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12392024-11-15T21:46:23.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12402024-11-15T21:46:23.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.511216ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
12412024-11-15T21:46:23.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12422024-11-15T21:46:23.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12432024-11-15T21:46:23.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12442024-11-15T21:46:23.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12452024-11-15T21:46:23.110ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12462024-11-15T21:46:23.110ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12472024-11-15T21:46:23.110ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12482024-11-15T21:46:23.110ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12492024-11-15T21:46:23.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c49da270-ae58-445b-bebc-a2503a0b4ecd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
12502024-11-15T21:46:23.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12512024-11-15T21:46:23.111ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 73393055 } })
12522024-11-15T21:46:23.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12532024-11-15T21:46:23.112ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
12542024-11-15T21:46:23.112ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12552024-11-15T21:46:23.112ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12562024-11-15T21:46:23.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12572024-11-15T21:46:23.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12582024-11-15T21:46:23.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12592024-11-15T21:46:23.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12602024-11-15T21:46:23.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12612024-11-15T21:46:23.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12622024-11-15T21:46:23.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12632024-11-15T21:46:23.116ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
12642024-11-15T21:46:23.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
12652024-11-15T21:46:23.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12662024-11-15T21:46:23.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12672024-11-15T21:46:23.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12682024-11-15T21:46:23.125ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12692024-11-15T21:46:23.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12702024-11-15T21:46:23.132ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12712024-11-15T21:46:23.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12722024-11-15T21:46:23.136ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
12732024-11-15T21:46:23.139ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
12742024-11-15T21:46:23.139ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 127.069615ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
12752024-11-15T21:46:23.140ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12762024-11-15T21:46:23.140ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
12772024-11-15T21:46:23.140ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 128.638095ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
12782024-11-15T21:46:23.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 129.047077ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
12792024-11-15T21:46:23.144ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12802024-11-15T21:46:23.144ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.749501ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12812024-11-15T21:46:23.148ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
12822024-11-15T21:46:23.148ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12832024-11-15T21:46:23.148ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "74c38d15-8e96-49b7-929b-510ff892ee7e", "content-length": "26", "date": "Fri, 15 Nov 2024 21:46:22 GMT"} })
12842024-11-15T21:46:23.148ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12852024-11-15T21:46:23.151ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12862024-11-15T21:46:23.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12872024-11-15T21:46:23.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12882024-11-15T21:46:23.155ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12892024-11-15T21:46:23.155ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12902024-11-15T21:46:23.155ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12912024-11-15T21:46:23.155ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12922024-11-15T21:46:23.155ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12932024-11-15T21:46:23.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12942024-11-15T21:46:23.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12952024-11-15T21:46:23.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12962024-11-15T21:46:23.156ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 144.376267ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12972024-11-15T21:46:23.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12982024-11-15T21:46:23.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12992024-11-15T21:46:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13002024-11-15T21:46:23.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13012024-11-15T21:46:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13022024-11-15T21:46:23.160ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13032024-11-15T21:46:23.160ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13042024-11-15T21:46:23.160ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13052024-11-15T21:46:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13062024-11-15T21:46:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
13072024-11-15T21:46:23.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13082024-11-15T21:46:23.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13092024-11-15T21:46:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13102024-11-15T21:46:23.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13112024-11-15T21:46:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13122024-11-15T21:46:23.167ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
13132024-11-15T21:46:23.167ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13142024-11-15T21:46:23.168ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "71ef69c7-c44b-4b93-b625-b37bc01bc847", "content-length": "26", "date": "Fri, 15 Nov 2024 21:46:22 GMT"} })
13152024-11-15T21:46:23.168ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13162024-11-15T21:46:23.172ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13172024-11-15T21:46:23.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13182024-11-15T21:46:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13192024-11-15T21:46:23.174ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13202024-11-15T21:46:23.174ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13212024-11-15T21:46:23.174ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13222024-11-15T21:46:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13232024-11-15T21:46:23.201ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13242024-11-15T21:46:23.201ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
13252024-11-15T21:46:23.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13262024-11-15T21:46:23.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13272024-11-15T21:46:23.203ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13282024-11-15T21:46:23.203ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13292024-11-15T21:46:23.203ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 191.076811ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
13302024-11-15T21:46:23.222ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 210.308265ms iteration = 12 status = {"physical_disks_added":0}
13312024-11-15T21:46:23.233ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
13322024-11-15T21:46:23.233ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 221.196946ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
13332024-11-15T21:46:23.277ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
13342024-11-15T21:46:23.277ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13352024-11-15T21:46:23.277ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83d3b6a6-b0e7-4128-87c4-ede1046f7699", "content-length": "26", "date": "Fri, 15 Nov 2024 21:46:22 GMT"} })
13362024-11-15T21:46:23.277ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13372024-11-15T21:46:23.280ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
13382024-11-15T21:46:23.397ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13392024-11-15T21:46:23.426ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 414.670131ms iteration = 9 status = {}
13402024-11-15T21:46:23.462ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
13412024-11-15T21:46:23.462ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "48d8e50c-57ab-4bef-a689-7c194cec4e85", "date": "Fri, 15 Nov 2024 21:46:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13422024-11-15T21:46:23.462ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13432024-11-15T21:46:23.464ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3f63e70b-eaf3-42a7-8f8b-1794993543d3", "date": "Fri, 15 Nov 2024 21:46:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13442024-11-15T21:46:23.464ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13452024-11-15T21:46:23.466ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13462024-11-15T21:46:23.466ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 454.204448ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13472024-11-15T21:46:23.468ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13482024-11-15T21:46:23.468ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13492024-11-15T21:46:23.469ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ba122c7-8d98-4b4d-9026-0bc682b500e0", "content-length": "372", "date": "Fri, 15 Nov 2024 21:46:22 GMT"} })
13502024-11-15T21:46:23.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13512024-11-15T21:46:23.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13522024-11-15T21:46:23.471ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 459.357372ms iteration = 9 status = 0
13532024-11-15T21:46:23.473ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13542024-11-15T21:46:23.473ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3125a38-8a0f-42d3-b95b-8ec4878d5419", "content-length": "1", "date": "Fri, 15 Nov 2024 21:46:23 GMT"} })
13552024-11-15T21:46:23.474ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13562024-11-15T21:46:23.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13572024-11-15T21:46:23.477ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 465.517442ms iteration = 9 status = null
13582024-11-15T21:46:23.503ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13592024-11-15T21:46:23.503ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13602024-11-15T21:46:23.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13612024-11-15T21:46:23.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13622024-11-15T21:46:23.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13632024-11-15T21:46:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13642024-11-15T21:46:23.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13652024-11-15T21:46:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13662024-11-15T21:46:23.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13672024-11-15T21:46:23.509ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
13682024-11-15T21:46:23.509ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13692024-11-15T21:46:23.509ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
13702024-11-15T21:46:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 497.364298ms iteration = 6 status = {"generation":2}
13712024-11-15T21:46:23.509ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
13722024-11-15T21:46:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 497.991433ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13732024-11-15T21:46:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13742024-11-15T21:46:23.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13752024-11-15T21:46:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13762024-11-15T21:46:23.512ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13772024-11-15T21:46:23.512ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13782024-11-15T21:46:23.512ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
13792024-11-15T21:46:23.512ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 500.857501ms iteration = 6 status = {"generation":1}
13802024-11-15T21:46:23.513ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
13812024-11-15T21:46:23.513ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13822024-11-15T21:46:23.513ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f5c21aa9-b92d-43d3-8e4a-0f9b321339f1", "date": "Fri, 15 Nov 2024 21:46:22 GMT"} })
13832024-11-15T21:46:23.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13842024-11-15T21:46:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13852024-11-15T21:46:23.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13862024-11-15T21:46:23.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13872024-11-15T21:46:23.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13882024-11-15T21:46:23.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13892024-11-15T21:46:23.524ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13902024-11-15T21:46:23.524ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13912024-11-15T21:46:23.525ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8c7251f7-d11f-4755-8871-68080c4a4ab8", "date": "Fri, 15 Nov 2024 21:46:22 GMT"} })
13922024-11-15T21:46:23.527ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 515.447326ms iteration = 10 status = {}
13932024-11-15T21:46:23.527ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13942024-11-15T21:46:23.527ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "21dd0462-1747-4b43-9633-1929982c32cd", "date": "Fri, 15 Nov 2024 21:46:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13952024-11-15T21:46:23.527ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13962024-11-15T21:46:23.529ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "93b81657-c857-4a26-b6b2-bc3029efd9fe", "date": "Fri, 15 Nov 2024 21:46:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13972024-11-15T21:46:23.529ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13982024-11-15T21:46:23.531ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3a959129-91fb-4572-9f72-f897ae984466", "date": "Fri, 15 Nov 2024 21:46:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13992024-11-15T21:46:23.531ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
14002024-11-15T21:46:23.533ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
14012024-11-15T21:46:23.533ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 521.143142ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14022024-11-15T21:46:23.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14032024-11-15T21:46:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14042024-11-15T21:46:23.573ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
14052024-11-15T21:46:23.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14062024-11-15T21:46:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14072024-11-15T21:46:23.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14082024-11-15T21:46:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14092024-11-15T21:46:23.582ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14102024-11-15T21:46:23.582ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a15f971b-3ebc-4c10-b8d2-ce2f2daa84d5", "content-length": "134", "date": "Fri, 15 Nov 2024 21:46:23 GMT"} })
14112024-11-15T21:46:23.582ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
14122024-11-15T21:46:23.582ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
14132024-11-15T21:46:23.583ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14142024-11-15T21:46:23.583ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14152024-11-15T21:46:23.583ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14162024-11-15T21:46:23.583ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14172024-11-15T21:46:23.583ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14182024-11-15T21:46:23.583ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14192024-11-15T21:46:23.583ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14202024-11-15T21:46:23.583ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14212024-11-15T21:46:23.583ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
14222024-11-15T21:46:23.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14232024-11-15T21:46:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14242024-11-15T21:46:23.585ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14252024-11-15T21:46:23.586ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "80dd57f1-69ae-48a5-8804-62cc4934b7c2", "content-length": "2", "date": "Fri, 15 Nov 2024 21:46:23 GMT"} })
14262024-11-15T21:46:23.586ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14272024-11-15T21:46:23.586ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ffa5988-ffad-42dd-ad03-3a0aace85200", "content-length": "52", "date": "Fri, 15 Nov 2024 21:46:23 GMT"} })
14282024-11-15T21:46:23.586ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
14292024-11-15T21:46:23.586ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14302024-11-15T21:46:23.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14312024-11-15T21:46:23.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14322024-11-15T21:46:23.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14332024-11-15T21:46:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14342024-11-15T21:46:23.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14352024-11-15T21:46:23.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14362024-11-15T21:46:23.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14372024-11-15T21:46:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14382024-11-15T21:46:23.684ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c944548b-c3a8-45e8-93d8-c923664e365f", "date": "Fri, 15 Nov 2024 21:46:22 GMT"} })
14392024-11-15T21:46:23.684ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
14402024-11-15T21:46:23.684ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14412024-11-15T21:46:23.684ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a910b0a-4613-4ba6-8a43-42c7981bcb9f", "content-length": "682", "date": "Fri, 15 Nov 2024 21:46:22 GMT"} })
14422024-11-15T21:46:23.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14432024-11-15T21:46:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14442024-11-15T21:46:23.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14452024-11-15T21:46:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14462024-11-15T21:46:23.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14472024-11-15T21:46:23.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14482024-11-15T21:46:23.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14492024-11-15T21:46:23.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14502024-11-15T21:46:23.699ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14512024-11-15T21:46:23.700ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "09a277cf-fcf3-4d5d-bbc7-378a64df131e", "content-length": "691", "date": "Fri, 15 Nov 2024 21:46:23 GMT"} })
14522024-11-15T21:46:23.700ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14532024-11-15T21:46:23.700ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14542024-11-15T21:46:23.700ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14552024-11-15T21:46:23.701ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 689.797627ms iteration = 9 status = {}
14562024-11-15T21:46:23.704ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 692.700006ms iteration = 9 status = {}
14572024-11-15T21:46:23.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = aabfd68f-75a7-4a79-ada3-46fba1a11b00 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
14582024-11-15T21:46:23.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = aabfd68f-75a7-4a79-ada3-46fba1a11b00 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
14592024-11-15T21:46:23.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = aabfd68f-75a7-4a79-ada3-46fba1a11b00 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
14602024-11-15T21:46:24.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 73601c6e-b74f-48a7-8646-4648583e0da0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14612024-11-15T21:46:24.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 73601c6e-b74f-48a7-8646-4648583e0da0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14622024-11-15T21:46:24.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 73601c6e-b74f-48a7-8646-4648583e0da0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14632024-11-15T21:46:25.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d188d7f6-7161-4604-8e92-50500b50ba9b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14642024-11-15T21:46:25.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d188d7f6-7161-4604-8e92-50500b50ba9b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14652024-11-15T21:46:25.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d188d7f6-7161-4604-8e92-50500b50ba9b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14662024-11-15T21:46:26.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 36fdf704-426b-4a3c-b043-b9381a46a006 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14672024-11-15T21:46:26.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 36fdf704-426b-4a3c-b043-b9381a46a006 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14682024-11-15T21:46:26.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 36fdf704-426b-4a3c-b043-b9381a46a006 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14692024-11-15T21:46:27.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 79195a74-eee1-46d0-927e-e0902dbf1fe0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14702024-11-15T21:46:27.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 79195a74-eee1-46d0-927e-e0902dbf1fe0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14712024-11-15T21:46:27.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 79195a74-eee1-46d0-927e-e0902dbf1fe0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14722024-11-15T21:46:28.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c94c93dd-a355-410d-85ff-617e76cf6981 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14732024-11-15T21:46:28.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c94c93dd-a355-410d-85ff-617e76cf6981 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14742024-11-15T21:46:28.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c94c93dd-a355-410d-85ff-617e76cf6981 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14752024-11-15T21:46:29.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6013e9b9-3c84-49d3-b441-0ea8ce364377 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14762024-11-15T21:46:29.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6013e9b9-3c84-49d3-b441-0ea8ce364377 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14772024-11-15T21:46:29.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6013e9b9-3c84-49d3-b441-0ea8ce364377 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14782024-11-15T21:46:30.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 87cad8b8-cedb-41fb-8cd5-269ac1d7310a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14792024-11-15T21:46:30.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 87cad8b8-cedb-41fb-8cd5-269ac1d7310a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14802024-11-15T21:46:30.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 87cad8b8-cedb-41fb-8cd5-269ac1d7310a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14812024-11-15T21:46:30.648ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1275 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 15831ff0-a521-40ce-b37e-f440262fce50 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
14822024-11-15T21:46:31.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 73c8de4f-0192-4f71-9ce5-99b2f1a5070e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14832024-11-15T21:46:31.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 73c8de4f-0192-4f71-9ce5-99b2f1a5070e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14842024-11-15T21:46:31.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 73c8de4f-0192-4f71-9ce5-99b2f1a5070e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14852024-11-15T21:46:32.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3ca981f3-2b00-46ed-8b8a-93c686b80ca1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14862024-11-15T21:46:32.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3ca981f3-2b00-46ed-8b8a-93c686b80ca1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14872024-11-15T21:46:32.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3ca981f3-2b00-46ed-8b8a-93c686b80ca1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
14882024-11-15T21:46:33.005ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
14892024-11-15T21:46:33.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14902024-11-15T21:46:33.005ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
14912024-11-15T21:46:33.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14922024-11-15T21:46:33.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14932024-11-15T21:46:33.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14942024-11-15T21:46:33.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14952024-11-15T21:46:33.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14962024-11-15T21:46:33.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14972024-11-15T21:46:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14982024-11-15T21:46:33.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14992024-11-15T21:46:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15002024-11-15T21:46:33.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15012024-11-15T21:46:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15022024-11-15T21:46:33.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15032024-11-15T21:46:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
15042024-11-15T21:46:33.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15052024-11-15T21:46:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15062024-11-15T21:46:33.025ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
15072024-11-15T21:46:33.025ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.770835ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
15082024-11-15T21:46:33.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.273536ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15092024-11-15T21:46:33.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a89785c2-46b1-4177-bb73-da49dcf1f3e1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15102024-11-15T21:46:33.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a89785c2-46b1-4177-bb73-da49dcf1f3e1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15112024-11-15T21:46:33.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a89785c2-46b1-4177-bb73-da49dcf1f3e1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15122024-11-15T21:46:34.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 462f0179-2f16-4da2-8ddb-e2b214217666 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15132024-11-15T21:46:34.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 462f0179-2f16-4da2-8ddb-e2b214217666 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15142024-11-15T21:46:34.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 462f0179-2f16-4da2-8ddb-e2b214217666 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15152024-11-15T21:46:35.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d93ebd70-4d37-4ae2-826a-56135c65c651 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15162024-11-15T21:46:35.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d93ebd70-4d37-4ae2-826a-56135c65c651 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15172024-11-15T21:46:35.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d93ebd70-4d37-4ae2-826a-56135c65c651 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15182024-11-15T21:46:35.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 407f24a1-6fbb-4d79-b015-aaa22cfee189 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
15192024-11-15T21:46:35.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 407f24a1-6fbb-4d79-b015-aaa22cfee189 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
15202024-11-15T21:46:35.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 407f24a1-6fbb-4d79-b015-aaa22cfee189 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
15212024-11-15T21:46:35.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d4ab9969-e3bb-400b-9385-47afd9edfc85 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
15222024-11-15T21:46:35.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d4ab9969-e3bb-400b-9385-47afd9edfc85 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
15232024-11-15T21:46:35.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d4ab9969-e3bb-400b-9385-47afd9edfc85 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
15242024-11-15T21:46:36.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 97538b8d-e54e-43cd-b0d7-b1b54f3a69cf roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15252024-11-15T21:46:36.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 97538b8d-e54e-43cd-b0d7-b1b54f3a69cf resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15262024-11-15T21:46:36.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 97538b8d-e54e-43cd-b0d7-b1b54f3a69cf response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15272024-11-15T21:46:37.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 24252d46-a5d1-4210-8485-115dec96f416 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15282024-11-15T21:46:37.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 24252d46-a5d1-4210-8485-115dec96f416 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15292024-11-15T21:46:37.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 24252d46-a5d1-4210-8485-115dec96f416 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15302024-11-15T21:46:38.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f745e6da-76e5-4de8-b626-a0ad13eb370a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15312024-11-15T21:46:38.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f745e6da-76e5-4de8-b626-a0ad13eb370a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15322024-11-15T21:46:38.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f745e6da-76e5-4de8-b626-a0ad13eb370a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15332024-11-15T21:46:39.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 220c71e7-aebc-419b-a838-420a1c6b7993 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15342024-11-15T21:46:39.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 220c71e7-aebc-419b-a838-420a1c6b7993 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15352024-11-15T21:46:39.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 220c71e7-aebc-419b-a838-420a1c6b7993 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15362024-11-15T21:46:40.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dc2a03ea-1426-454e-82b5-6f16bf29b29a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15372024-11-15T21:46:40.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dc2a03ea-1426-454e-82b5-6f16bf29b29a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15382024-11-15T21:46:40.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dc2a03ea-1426-454e-82b5-6f16bf29b29a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15392024-11-15T21:46:41.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d36be262-aa69-46e7-8e6d-c7fcbe9979ca roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15402024-11-15T21:46:41.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d36be262-aa69-46e7-8e6d-c7fcbe9979ca resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15412024-11-15T21:46:41.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d36be262-aa69-46e7-8e6d-c7fcbe9979ca response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15422024-11-15T21:46:42.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9281173a-1fa4-4a54-8b00-486f26ddafd7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15432024-11-15T21:46:42.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9281173a-1fa4-4a54-8b00-486f26ddafd7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15442024-11-15T21:46:42.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9281173a-1fa4-4a54-8b00-486f26ddafd7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15452024-11-15T21:46:43.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
15462024-11-15T21:46:43.005ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
15472024-11-15T21:46:43.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15482024-11-15T21:46:43.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15492024-11-15T21:46:43.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15502024-11-15T21:46:43.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15512024-11-15T21:46:43.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15522024-11-15T21:46:43.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15532024-11-15T21:46:43.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15542024-11-15T21:46:43.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.809185ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15552024-11-15T21:46:43.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15562024-11-15T21:46:43.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15572024-11-15T21:46:43.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15582024-11-15T21:46:43.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15592024-11-15T21:46:43.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15602024-11-15T21:46:43.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612024-11-15T21:46:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
15622024-11-15T21:46:43.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15632024-11-15T21:46:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15642024-11-15T21:46:43.027ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
15652024-11-15T21:46:43.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.191124ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
15662024-11-15T21:46:43.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fb1cd600-1953-4dcd-8aca-70bb33de4e0d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15672024-11-15T21:46:43.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fb1cd600-1953-4dcd-8aca-70bb33de4e0d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15682024-11-15T21:46:43.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fb1cd600-1953-4dcd-8aca-70bb33de4e0d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15692024-11-15T21:46:44.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b06d2cbf-b095-402f-8e2f-49d0ccadbb55 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15702024-11-15T21:46:44.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b06d2cbf-b095-402f-8e2f-49d0ccadbb55 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15712024-11-15T21:46:44.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b06d2cbf-b095-402f-8e2f-49d0ccadbb55 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15722024-11-15T21:46:45.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = de0f7ba3-be52-4464-b536-cabd9e530f60 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15732024-11-15T21:46:45.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = de0f7ba3-be52-4464-b536-cabd9e530f60 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15742024-11-15T21:46:45.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = de0f7ba3-be52-4464-b536-cabd9e530f60 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15752024-11-15T21:46:45.649ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 550544c3-2b77-4f2d-a70b-d90e623b37ea response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
15762024-11-15T21:46:46.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 629b07e2-e3ca-4104-a8a4-6330a89c29e6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15772024-11-15T21:46:46.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 629b07e2-e3ca-4104-a8a4-6330a89c29e6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15782024-11-15T21:46:46.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 629b07e2-e3ca-4104-a8a4-6330a89c29e6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15792024-11-15T21:46:47.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3a2fbc11-fc1f-449b-8da5-dc7e88562ab9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15802024-11-15T21:46:47.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3a2fbc11-fc1f-449b-8da5-dc7e88562ab9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15812024-11-15T21:46:47.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3a2fbc11-fc1f-449b-8da5-dc7e88562ab9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15822024-11-15T21:46:48.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6e2010cb-75a4-4c91-a06c-14a8e991dd0f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15832024-11-15T21:46:48.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6e2010cb-75a4-4c91-a06c-14a8e991dd0f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15842024-11-15T21:46:48.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6e2010cb-75a4-4c91-a06c-14a8e991dd0f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15852024-11-15T21:46:49.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0d379d7b-c9ce-4b75-9087-6646b56ceb62 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15862024-11-15T21:46:49.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0d379d7b-c9ce-4b75-9087-6646b56ceb62 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15872024-11-15T21:46:49.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0d379d7b-c9ce-4b75-9087-6646b56ceb62 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15882024-11-15T21:46:50.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 92b39365-af45-46c7-8866-37c97dda8b2a roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
15892024-11-15T21:46:50.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 92b39365-af45-46c7-8866-37c97dda8b2a resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
15902024-11-15T21:46:50.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 92b39365-af45-46c7-8866-37c97dda8b2a response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
15912024-11-15T21:46:50.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 51f4420a-0e9e-4a77-87ab-f91ea7bdc72b roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
15922024-11-15T21:46:50.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 51f4420a-0e9e-4a77-87ab-f91ea7bdc72b resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
15932024-11-15T21:46:50.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 51f4420a-0e9e-4a77-87ab-f91ea7bdc72b response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
15942024-11-15T21:46:50.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 442fca53-fa24-467e-b05a-ae820de1eae3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15952024-11-15T21:46:50.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 442fca53-fa24-467e-b05a-ae820de1eae3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15962024-11-15T21:46:50.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 442fca53-fa24-467e-b05a-ae820de1eae3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15972024-11-15T21:46:51.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 213232e5-bf74-478d-8ce8-a46b7140e76e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15982024-11-15T21:46:51.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 213232e5-bf74-478d-8ce8-a46b7140e76e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
15992024-11-15T21:46:51.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 213232e5-bf74-478d-8ce8-a46b7140e76e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
16002024-11-15T21:46:52.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f103fdec-bc9c-4dee-8b28-2b75bc89170a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
16012024-11-15T21:46:52.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f103fdec-bc9c-4dee-8b28-2b75bc89170a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
16022024-11-15T21:46:52.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f103fdec-bc9c-4dee-8b28-2b75bc89170a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
16032024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
16042024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16052024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
16062024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16072024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
16082024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16092024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
16102024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
16112024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16122024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16132024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
16142024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16152024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
16162024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16172024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16182024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
16192024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
16202024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16212024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
16222024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16232024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16242024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
16252024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
16262024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16272024-11-15T21:46:53.004ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16282024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16292024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
16302024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16312024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
16322024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16332024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
16342024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16352024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
16362024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16372024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
16382024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16392024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16402024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16412024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16422024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16432024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16442024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16452024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16462024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16472024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16482024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16492024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16502024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16512024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16522024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16532024-11-15T21:46:53.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16542024-11-15T21:46:53.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.469047ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
16552024-11-15T21:46:53.007ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.978879ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16562024-11-15T21:46:53.008ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16572024-11-15T21:46:53.008ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 978320976 } })
16582024-11-15T21:46:53.009ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
16592024-11-15T21:46:53.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16602024-11-15T21:46:53.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16612024-11-15T21:46:53.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16622024-11-15T21:46:53.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16632024-11-15T21:46:53.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16642024-11-15T21:46:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16652024-11-15T21:46:53.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16662024-11-15T21:46:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16672024-11-15T21:46:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16682024-11-15T21:46:53.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16692024-11-15T21:46:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16702024-11-15T21:46:53.020ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 989684590 } })
16712024-11-15T21:46:53.020ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
16722024-11-15T21:46:53.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16732024-11-15T21:46:53.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16742024-11-15T21:46:53.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16752024-11-15T21:46:53.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16762024-11-15T21:46:53.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16772024-11-15T21:46:53.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16782024-11-15T21:46:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16792024-11-15T21:46:53.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16802024-11-15T21:46:53.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16812024-11-15T21:46:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16822024-11-15T21:46:53.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16832024-11-15T21:46:53.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16842024-11-15T21:46:53.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16852024-11-15T21:46:53.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16862024-11-15T21:46:53.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16872024-11-15T21:46:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16882024-11-15T21:46:53.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16892024-11-15T21:46:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16902024-11-15T21:46:53.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16912024-11-15T21:46:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16922024-11-15T21:46:53.035ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 5337192 } })
16932024-11-15T21:46:53.036ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
16942024-11-15T21:46:53.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16952024-11-15T21:46:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16962024-11-15T21:46:53.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16972024-11-15T21:46:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16982024-11-15T21:46:53.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16992024-11-15T21:46:53.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
17002024-11-15T21:46:53.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17012024-11-15T21:46:53.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17022024-11-15T21:46:53.053ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17032024-11-15T21:46:53.053ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17042024-11-15T21:46:53.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17052024-11-15T21:46:53.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17062024-11-15T21:46:53.072ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.181393ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
17072024-11-15T21:46:53.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17082024-11-15T21:46:53.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17092024-11-15T21:46:53.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17102024-11-15T21:46:53.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17112024-11-15T21:46:53.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17122024-11-15T21:46:53.075ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
17132024-11-15T21:46:53.075ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.487934ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
17142024-11-15T21:46:53.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17152024-11-15T21:46:53.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17162024-11-15T21:46:53.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17172024-11-15T21:46:53.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17182024-11-15T21:46:53.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17192024-11-15T21:46:53.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17202024-11-15T21:46:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17212024-11-15T21:46:53.085ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17222024-11-15T21:46:53.085ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.961796ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17232024-11-15T21:46:53.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17242024-11-15T21:46:53.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17252024-11-15T21:46:53.093ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
17262024-11-15T21:46:53.093ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17272024-11-15T21:46:53.093ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98593cac-5948-4e96-b0b7-e9e090c9baf2", "content-length": "26", "date": "Fri, 15 Nov 2024 21:46:52 GMT"} })
17282024-11-15T21:46:53.093ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17292024-11-15T21:46:53.095ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17302024-11-15T21:46:53.101ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17312024-11-15T21:46:53.101ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17322024-11-15T21:46:53.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17332024-11-15T21:46:53.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17342024-11-15T21:46:53.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.029503ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17352024-11-15T21:46:53.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17362024-11-15T21:46:53.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17372024-11-15T21:46:53.126ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
17382024-11-15T21:46:53.126ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17392024-11-15T21:46:53.127ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "520cc226-6e40-4775-a559-3d16c2a532fe", "content-length": "26", "date": "Fri, 15 Nov 2024 21:46:52 GMT"} })
17402024-11-15T21:46:53.127ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17412024-11-15T21:46:53.129ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17422024-11-15T21:46:53.141ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
17432024-11-15T21:46:53.141ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17442024-11-15T21:46:53.141ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03e432bc-d8d5-4baf-8272-acee985373e0", "content-length": "26", "date": "Fri, 15 Nov 2024 21:46:52 GMT"} })
17452024-11-15T21:46:53.141ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17462024-11-15T21:46:53.143ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
17472024-11-15T21:46:53.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17482024-11-15T21:46:53.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17492024-11-15T21:46:53.159ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 155.383619ms iteration = 13 status = {"physical_disks_added":0}
17502024-11-15T21:46:53.200ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17512024-11-15T21:46:53.200ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17522024-11-15T21:46:53.201ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "925ee166-d098-4605-86d2-27c65391a078", "content-length": "372", "date": "Fri, 15 Nov 2024 21:46:53 GMT"} })
17532024-11-15T21:46:53.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17542024-11-15T21:46:53.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17552024-11-15T21:46:53.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17562024-11-15T21:46:53.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 198.480988ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17572024-11-15T21:46:53.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17582024-11-15T21:46:53.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17592024-11-15T21:46:53.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17602024-11-15T21:46:53.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17612024-11-15T21:46:53.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17622024-11-15T21:46:53.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17632024-11-15T21:46:53.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17642024-11-15T21:46:53.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
17652024-11-15T21:46:53.208ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17662024-11-15T21:46:53.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17672024-11-15T21:46:53.210ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17682024-11-15T21:46:53.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17692024-11-15T21:46:53.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17702024-11-15T21:46:53.212ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 208.748345ms iteration = 10 status = {}
17712024-11-15T21:46:53.213ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 208.894276ms iteration = 10 status = 0
17722024-11-15T21:46:53.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 228.564983ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
17732024-11-15T21:46:53.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 229.237088ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
17742024-11-15T21:46:53.237ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17752024-11-15T21:46:53.237ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17762024-11-15T21:46:53.237ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 233.697257ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17772024-11-15T21:46:53.253ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17782024-11-15T21:46:53.253ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17792024-11-15T21:46:53.254ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1c0d98a0-8aa6-4e6c-88c8-dfd98f585586", "date": "Fri, 15 Nov 2024 21:46:53 GMT"} })
17802024-11-15T21:46:53.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17812024-11-15T21:46:53.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17822024-11-15T21:46:53.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17832024-11-15T21:46:53.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17842024-11-15T21:46:53.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17852024-11-15T21:46:53.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17862024-11-15T21:46:53.262ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17872024-11-15T21:46:53.262ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17882024-11-15T21:46:53.262ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6438ef43-8b17-4eac-ad95-77e82eff3b74", "date": "Fri, 15 Nov 2024 21:46:53 GMT"} })
17892024-11-15T21:46:53.263ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 259.581874ms iteration = 11 status = {}
17902024-11-15T21:46:53.322ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17912024-11-15T21:46:53.322ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf7a7e37-9676-45a0-8929-38d86c117c24", "content-length": "691", "date": "Fri, 15 Nov 2024 21:46:53 GMT"} })
17922024-11-15T21:46:53.322ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
17932024-11-15T21:46:53.322ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
17942024-11-15T21:46:53.322ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
17952024-11-15T21:46:53.323ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 319.744415ms iteration = 10 status = {}
17962024-11-15T21:46:53.334ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17972024-11-15T21:46:53.334ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfbf01a8-6d7a-4177-ac9b-0826d7974abd", "content-length": "1", "date": "Fri, 15 Nov 2024 21:46:52 GMT"} })
17982024-11-15T21:46:53.335ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17992024-11-15T21:46:53.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18002024-11-15T21:46:53.337ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 333.317503ms iteration = 10 status = null
18012024-11-15T21:46:53.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18022024-11-15T21:46:53.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18032024-11-15T21:46:53.403ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
18042024-11-15T21:46:53.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18052024-11-15T21:46:53.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18062024-11-15T21:46:53.410ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18072024-11-15T21:46:53.410ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "78a9bb73-266a-4cf5-8dec-31fbb7cd71f7", "content-length": "134", "date": "Fri, 15 Nov 2024 21:46:52 GMT"} })
18082024-11-15T21:46:53.410ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18092024-11-15T21:46:53.410ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
18102024-11-15T21:46:53.410ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18112024-11-15T21:46:53.410ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18122024-11-15T21:46:53.410ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18132024-11-15T21:46:53.410ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18142024-11-15T21:46:53.410ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18152024-11-15T21:46:53.411ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18162024-11-15T21:46:53.411ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18172024-11-15T21:46:53.411ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18182024-11-15T21:46:53.411ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
18192024-11-15T21:46:53.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18202024-11-15T21:46:53.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18212024-11-15T21:46:53.413ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18222024-11-15T21:46:53.414ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1253c3d-9893-46af-945b-db06794f1966", "content-length": "2", "date": "Fri, 15 Nov 2024 21:46:52 GMT"} })
18232024-11-15T21:46:53.414ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18242024-11-15T21:46:53.414ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f03d038f-9c87-44c9-a917-3c54947c4e30", "content-length": "52", "date": "Fri, 15 Nov 2024 21:46:52 GMT"} })
18252024-11-15T21:46:53.414ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
18262024-11-15T21:46:53.414ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18272024-11-15T21:46:53.501ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a0205317-7e04-4eb7-9e3e-611de6e803aa", "date": "Fri, 15 Nov 2024 21:46:53 GMT"} })
18282024-11-15T21:46:53.501ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
18292024-11-15T21:46:53.501ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18302024-11-15T21:46:53.501ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a02d65de-9319-4975-a720-3a7590ade21f", "content-length": "682", "date": "Fri, 15 Nov 2024 21:46:53 GMT"} })
18312024-11-15T21:46:53.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18322024-11-15T21:46:53.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18332024-11-15T21:46:53.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18342024-11-15T21:46:53.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18352024-11-15T21:46:53.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18362024-11-15T21:46:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18372024-11-15T21:46:53.510ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18382024-11-15T21:46:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18392024-11-15T21:46:53.518ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 513.852705ms iteration = 10 status = {}
18402024-11-15T21:46:53.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c78a82bd-f3c5-4f2f-837e-b3b0fa3b0cb1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18412024-11-15T21:46:53.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c78a82bd-f3c5-4f2f-837e-b3b0fa3b0cb1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18422024-11-15T21:46:53.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c78a82bd-f3c5-4f2f-837e-b3b0fa3b0cb1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18432024-11-15T21:46:53.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 70311d3a-26f1-47b4-9d1a-1d20bd679fc5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
18442024-11-15T21:46:53.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 70311d3a-26f1-47b4-9d1a-1d20bd679fc5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
18452024-11-15T21:46:53.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 70311d3a-26f1-47b4-9d1a-1d20bd679fc5 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
18462024-11-15T21:46:54.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ebff602-41ba-4a6d-aa56-73f77cee54d5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18472024-11-15T21:46:54.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ebff602-41ba-4a6d-aa56-73f77cee54d5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18482024-11-15T21:46:54.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ebff602-41ba-4a6d-aa56-73f77cee54d5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18492024-11-15T21:46:55.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0b934c7d-f3cb-4d2b-a807-b5301be56057 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18502024-11-15T21:46:55.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0b934c7d-f3cb-4d2b-a807-b5301be56057 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18512024-11-15T21:46:55.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0b934c7d-f3cb-4d2b-a807-b5301be56057 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18522024-11-15T21:46:56.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4daaeb27-6f6d-4767-b905-afe9e950ad35 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18532024-11-15T21:46:56.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4daaeb27-6f6d-4767-b905-afe9e950ad35 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18542024-11-15T21:46:56.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4daaeb27-6f6d-4767-b905-afe9e950ad35 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18552024-11-15T21:46:57.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d526f20c-bfd1-4dd8-b777-70da3d53dfb9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18562024-11-15T21:46:57.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d526f20c-bfd1-4dd8-b777-70da3d53dfb9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18572024-11-15T21:46:57.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d526f20c-bfd1-4dd8-b777-70da3d53dfb9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18582024-11-15T21:46:58.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a5a076c9-66ba-4b9c-a93e-188724729407 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18592024-11-15T21:46:58.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a5a076c9-66ba-4b9c-a93e-188724729407 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18602024-11-15T21:46:58.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a5a076c9-66ba-4b9c-a93e-188724729407 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18612024-11-15T21:46:59.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 25299ec2-6dd6-4404-ae83-46edc8324367 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18622024-11-15T21:46:59.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 25299ec2-6dd6-4404-ae83-46edc8324367 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18632024-11-15T21:46:59.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 25299ec2-6dd6-4404-ae83-46edc8324367 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18642024-11-15T21:47:00.648ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1665 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = b9a71712-ef4c-4785-b1ce-3b0a51bcb8fb response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
18652024-11-15T21:47:00.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 371fcb76-f505-4ee8-8664-e005f36bd461 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18662024-11-15T21:47:00.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 371fcb76-f505-4ee8-8664-e005f36bd461 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18672024-11-15T21:47:00.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 371fcb76-f505-4ee8-8664-e005f36bd461 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18682024-11-15T21:47:01.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 54199acb-2c26-4d68-ab5c-9b4274905c36 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18692024-11-15T21:47:01.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 54199acb-2c26-4d68-ab5c-9b4274905c36 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18702024-11-15T21:47:01.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 54199acb-2c26-4d68-ab5c-9b4274905c36 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18712024-11-15T21:47:02.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e042f466-7b8d-4411-b15d-cdf8e78c6034 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18722024-11-15T21:47:02.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e042f466-7b8d-4411-b15d-cdf8e78c6034 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18732024-11-15T21:47:02.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e042f466-7b8d-4411-b15d-cdf8e78c6034 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18742024-11-15T21:47:03.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
18752024-11-15T21:47:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
18762024-11-15T21:47:03.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18772024-11-15T21:47:03.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18782024-11-15T21:47:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18792024-11-15T21:47:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18802024-11-15T21:47:03.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18812024-11-15T21:47:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18822024-11-15T21:47:03.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18832024-11-15T21:47:03.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.842845ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18842024-11-15T21:47:03.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18852024-11-15T21:47:03.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18862024-11-15T21:47:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18872024-11-15T21:47:03.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18882024-11-15T21:47:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18892024-11-15T21:47:03.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18902024-11-15T21:47:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
18912024-11-15T21:47:03.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18922024-11-15T21:47:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18932024-11-15T21:47:03.034ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
18942024-11-15T21:47:03.034ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.418396ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
18952024-11-15T21:47:04.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5a51b095-2c1a-4d82-b0c2-600366a88ef1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18962024-11-15T21:47:04.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5a51b095-2c1a-4d82-b0c2-600366a88ef1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18972024-11-15T21:47:04.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5a51b095-2c1a-4d82-b0c2-600366a88ef1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18982024-11-15T21:47:05.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f65869a7-3c0a-4f35-834b-5c67b795be3b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
18992024-11-15T21:47:05.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f65869a7-3c0a-4f35-834b-5c67b795be3b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19002024-11-15T21:47:05.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f65869a7-3c0a-4f35-834b-5c67b795be3b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19012024-11-15T21:47:05.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 74a62958-364c-4f02-ace4-bad97f3f0121 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
19022024-11-15T21:47:05.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 74a62958-364c-4f02-ace4-bad97f3f0121 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
19032024-11-15T21:47:05.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2806 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 74a62958-364c-4f02-ace4-bad97f3f0121 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
19042024-11-15T21:47:05.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = e31cc6ff-0a2d-45ff-8365-1a7d65642d47 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
19052024-11-15T21:47:05.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = e31cc6ff-0a2d-45ff-8365-1a7d65642d47 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
19062024-11-15T21:47:05.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = e31cc6ff-0a2d-45ff-8365-1a7d65642d47 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
19072024-11-15T21:47:06.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e5185ab3-e54c-4523-9644-c77b0a5b7f07 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19082024-11-15T21:47:06.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e5185ab3-e54c-4523-9644-c77b0a5b7f07 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19092024-11-15T21:47:06.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e5185ab3-e54c-4523-9644-c77b0a5b7f07 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19102024-11-15T21:47:07.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 57362cec-c5f5-4bb4-8c70-5b0438b56b2a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19112024-11-15T21:47:07.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 57362cec-c5f5-4bb4-8c70-5b0438b56b2a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19122024-11-15T21:47:07.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 57362cec-c5f5-4bb4-8c70-5b0438b56b2a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19132024-11-15T21:47:08.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ace66ba3-3d27-481d-a47b-43f715102de7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19142024-11-15T21:47:08.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ace66ba3-3d27-481d-a47b-43f715102de7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19152024-11-15T21:47:08.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ace66ba3-3d27-481d-a47b-43f715102de7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19162024-11-15T21:47:09.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ae479e2e-9f59-4d8a-bf4b-6e1a3c83d613 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19172024-11-15T21:47:09.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ae479e2e-9f59-4d8a-bf4b-6e1a3c83d613 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19182024-11-15T21:47:09.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ae479e2e-9f59-4d8a-bf4b-6e1a3c83d613 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19192024-11-15T21:47:10.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b4ad602b-c978-4a38-9ac4-498b2c9e9ae8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19202024-11-15T21:47:10.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b4ad602b-c978-4a38-9ac4-498b2c9e9ae8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19212024-11-15T21:47:10.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b4ad602b-c978-4a38-9ac4-498b2c9e9ae8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19222024-11-15T21:47:11.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cd0e1cf9-7146-4345-bb6d-1ec8c6d2765d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19232024-11-15T21:47:11.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cd0e1cf9-7146-4345-bb6d-1ec8c6d2765d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19242024-11-15T21:47:11.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cd0e1cf9-7146-4345-bb6d-1ec8c6d2765d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19252024-11-15T21:47:12.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 78b9e55b-86a6-479c-b0db-83138e18c8b5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19262024-11-15T21:47:12.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 78b9e55b-86a6-479c-b0db-83138e18c8b5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19272024-11-15T21:47:12.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 78b9e55b-86a6-479c-b0db-83138e18c8b5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19282024-11-15T21:47:13.016ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
19292024-11-15T21:47:13.017ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19302024-11-15T21:47:13.017ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
19312024-11-15T21:47:13.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19322024-11-15T21:47:13.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19332024-11-15T21:47:13.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19342024-11-15T21:47:13.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19352024-11-15T21:47:13.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19362024-11-15T21:47:13.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372024-11-15T21:47:13.020ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.059637ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19382024-11-15T21:47:13.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19392024-11-15T21:47:13.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19402024-11-15T21:47:13.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19412024-11-15T21:47:13.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19422024-11-15T21:47:13.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19432024-11-15T21:47:13.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19442024-11-15T21:47:13.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
19452024-11-15T21:47:13.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19462024-11-15T21:47:13.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19472024-11-15T21:47:13.037ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
19482024-11-15T21:47:13.037ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.295262ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
19492024-11-15T21:47:13.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 13676dd0-1d9b-4715-ac4e-899a71a76fbd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19502024-11-15T21:47:13.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 13676dd0-1d9b-4715-ac4e-899a71a76fbd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19512024-11-15T21:47:13.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 13676dd0-1d9b-4715-ac4e-899a71a76fbd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19522024-11-15T21:47:14.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8b423bc7-e67d-4687-b347-3ddd18c2de81 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19532024-11-15T21:47:14.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8b423bc7-e67d-4687-b347-3ddd18c2de81 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19542024-11-15T21:47:14.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8b423bc7-e67d-4687-b347-3ddd18c2de81 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19552024-11-15T21:47:15.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7c8eb69-4485-4bd2-9366-4dfd9f56cf46 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19562024-11-15T21:47:15.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7c8eb69-4485-4bd2-9366-4dfd9f56cf46 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19572024-11-15T21:47:15.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7c8eb69-4485-4bd2-9366-4dfd9f56cf46 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19582024-11-15T21:47:15.657ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1225 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 16031b14-05c8-4664-90a2-264f58b6ca34 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
19592024-11-15T21:47:16.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d7454299-1513-44aa-b008-1d9c505c7f52 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19602024-11-15T21:47:16.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d7454299-1513-44aa-b008-1d9c505c7f52 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19612024-11-15T21:47:16.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d7454299-1513-44aa-b008-1d9c505c7f52 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19622024-11-15T21:47:17.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1c1f25c0-e2f7-4934-b500-02288220b054 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19632024-11-15T21:47:17.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1c1f25c0-e2f7-4934-b500-02288220b054 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19642024-11-15T21:47:17.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1c1f25c0-e2f7-4934-b500-02288220b054 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19652024-11-15T21:47:18.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f0a7fd36-2233-489d-902d-50604abf07d5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19662024-11-15T21:47:18.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f0a7fd36-2233-489d-902d-50604abf07d5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19672024-11-15T21:47:18.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f0a7fd36-2233-489d-902d-50604abf07d5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19682024-11-15T21:47:19.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 57f29927-699f-41a9-a095-72f4a6968610 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19692024-11-15T21:47:19.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 57f29927-699f-41a9-a095-72f4a6968610 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19702024-11-15T21:47:19.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 57f29927-699f-41a9-a095-72f4a6968610 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19712024-11-15T21:47:20.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bc7c2173-1a60-4a25-a906-d9316d9595a4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19722024-11-15T21:47:20.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bc7c2173-1a60-4a25-a906-d9316d9595a4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19732024-11-15T21:47:20.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bc7c2173-1a60-4a25-a906-d9316d9595a4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19742024-11-15T21:47:20.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d4945f8c-87db-4f0e-bf75-1eda4875bec2 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
19752024-11-15T21:47:20.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d4945f8c-87db-4f0e-bf75-1eda4875bec2 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
19762024-11-15T21:47:20.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d4945f8c-87db-4f0e-bf75-1eda4875bec2 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
19772024-11-15T21:47:20.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0673beb0-0d53-490e-8d04-95ac9716f797 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
19782024-11-15T21:47:20.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0673beb0-0d53-490e-8d04-95ac9716f797 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
19792024-11-15T21:47:20.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0673beb0-0d53-490e-8d04-95ac9716f797 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
19802024-11-15T21:47:21.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 113e0575-3237-45ea-b79f-fde80fecde88 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19812024-11-15T21:47:21.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 113e0575-3237-45ea-b79f-fde80fecde88 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19822024-11-15T21:47:21.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 113e0575-3237-45ea-b79f-fde80fecde88 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19832024-11-15T21:47:22.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f2a5008e-5de3-4354-8071-8bd6a4f59983 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19842024-11-15T21:47:22.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f2a5008e-5de3-4354-8071-8bd6a4f59983 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19852024-11-15T21:47:22.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f2a5008e-5de3-4354-8071-8bd6a4f59983 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
19862024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
19872024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
19882024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19892024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
19902024-11-15T21:47:23.010ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19912024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19922024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
19932024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
19942024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
19952024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19962024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19972024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
19982024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
19992024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
20002024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20012024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
20022024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20032024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
20042024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
20052024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20062024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
20072024-11-15T21:47:23.010ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
20082024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20092024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20102024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
20112024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
20122024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20132024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20142024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
20152024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20162024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
20172024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
20182024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
20192024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
20202024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20212024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
20222024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20232024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
20242024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20252024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
20262024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20272024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20282024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
20292024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
20302024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20312024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
20322024-11-15T21:47:23.010ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
20332024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20342024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
20352024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
20362024-11-15T21:47:23.010ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
20372024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20382024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.31\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
20392024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
20402024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
20412024-11-15T21:47:23.010ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:37:23.010657170 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
20422024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
20432024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
20442024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
20452024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
20462024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20472024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
20482024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
20492024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20502024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20512024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20522024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20532024-11-15T21:47:23.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20542024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20552024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20562024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20572024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20582024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20592024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20602024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20612024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20622024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20632024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20642024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
20652024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20662024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20672024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20682024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20692024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20702024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
20712024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20722024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
20732024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20742024-11-15T21:47:23.011ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 974213376 } })
20752024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20762024-11-15T21:47:23.011ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 974261256 } })
20772024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20782024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
20792024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.323718ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
20802024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
20812024-11-15T21:47:23.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.664061ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
20822024-11-15T21:47:23.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20832024-11-15T21:47:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20842024-11-15T21:47:23.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20852024-11-15T21:47:23.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20862024-11-15T21:47:23.015ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.024292ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20872024-11-15T21:47:23.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20882024-11-15T21:47:23.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20892024-11-15T21:47:23.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20902024-11-15T21:47:23.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20912024-11-15T21:47:23.017ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20922024-11-15T21:47:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20932024-11-15T21:47:23.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20942024-11-15T21:47:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20952024-11-15T21:47:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20962024-11-15T21:47:23.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20972024-11-15T21:47:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20982024-11-15T21:47:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20992024-11-15T21:47:23.019ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21002024-11-15T21:47:23.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21012024-11-15T21:47:23.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21022024-11-15T21:47:23.020ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 983587837 } })
21032024-11-15T21:47:23.020ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
21042024-11-15T21:47:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21052024-11-15T21:47:23.022ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21062024-11-15T21:47:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21072024-11-15T21:47:23.023ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21082024-11-15T21:47:23.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21092024-11-15T21:47:23.025ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 988022375 } })
21102024-11-15T21:47:23.025ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
21112024-11-15T21:47:23.026ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21122024-11-15T21:47:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21132024-11-15T21:47:23.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21142024-11-15T21:47:23.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21152024-11-15T21:47:23.027ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.105301ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
21162024-11-15T21:47:23.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21172024-11-15T21:47:23.028ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:37:23.010657170 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
21182024-11-15T21:47:23.028ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.183338ms iteration = 6 status = {"expiration":"2024-11-15T21:37:23.010657170Z","pruned":[]}
21192024-11-15T21:47:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21202024-11-15T21:47:23.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21212024-11-15T21:47:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21222024-11-15T21:47:23.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21232024-11-15T21:47:23.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21242024-11-15T21:47:23.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21252024-11-15T21:47:23.038ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21262024-11-15T21:47:23.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21272024-11-15T21:47:23.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21282024-11-15T21:47:23.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21292024-11-15T21:47:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21302024-11-15T21:47:23.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21312024-11-15T21:47:23.043ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 6631796 } })
21322024-11-15T21:47:23.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21332024-11-15T21:47:23.044ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
21342024-11-15T21:47:23.046ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21352024-11-15T21:47:23.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21362024-11-15T21:47:23.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21372024-11-15T21:47:23.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21382024-11-15T21:47:23.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21392024-11-15T21:47:23.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21402024-11-15T21:47:23.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21412024-11-15T21:47:23.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21422024-11-15T21:47:23.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21432024-11-15T21:47:23.050ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21442024-11-15T21:47:23.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21452024-11-15T21:47:23.051ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21462024-11-15T21:47:23.051ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 41.412359ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21472024-11-15T21:47:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21482024-11-15T21:47:23.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21492024-11-15T21:47:23.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21502024-11-15T21:47:23.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21512024-11-15T21:47:23.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
21522024-11-15T21:47:23.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21532024-11-15T21:47:23.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21542024-11-15T21:47:23.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21552024-11-15T21:47:23.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.340116ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
21562024-11-15T21:47:23.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21572024-11-15T21:47:23.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21582024-11-15T21:47:23.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21592024-11-15T21:47:23.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21602024-11-15T21:47:23.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21612024-11-15T21:47:23.075ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21622024-11-15T21:47:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21632024-11-15T21:47:23.077ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21642024-11-15T21:47:23.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21652024-11-15T21:47:23.077ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.532109ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
21662024-11-15T21:47:23.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21672024-11-15T21:47:23.080ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
21682024-11-15T21:47:23.080ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
21692024-11-15T21:47:23.080ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.652672ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
21702024-11-15T21:47:23.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21712024-11-15T21:47:23.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21722024-11-15T21:47:23.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21732024-11-15T21:47:23.084ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21742024-11-15T21:47:23.084ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21752024-11-15T21:47:23.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21762024-11-15T21:47:23.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21772024-11-15T21:47:23.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.351669ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21782024-11-15T21:47:23.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21792024-11-15T21:47:23.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21802024-11-15T21:47:23.087ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21812024-11-15T21:47:23.087ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21822024-11-15T21:47:23.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21832024-11-15T21:47:23.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21842024-11-15T21:47:23.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21852024-11-15T21:47:23.088ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
21862024-11-15T21:47:23.088ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.114217ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
21872024-11-15T21:47:23.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21882024-11-15T21:47:23.089ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21892024-11-15T21:47:23.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.209404ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21902024-11-15T21:47:23.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21912024-11-15T21:47:23.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21922024-11-15T21:47:23.093ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21932024-11-15T21:47:23.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21942024-11-15T21:47:23.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21952024-11-15T21:47:23.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21962024-11-15T21:47:23.094ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21972024-11-15T21:47:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21982024-11-15T21:47:23.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21992024-11-15T21:47:23.095ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22002024-11-15T21:47:23.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22012024-11-15T21:47:23.096ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
22022024-11-15T21:47:23.096ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
22032024-11-15T21:47:23.096ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
22042024-11-15T21:47:23.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22052024-11-15T21:47:23.096ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22062024-11-15T21:47:23.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22072024-11-15T21:47:23.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22082024-11-15T21:47:23.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.681783ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22092024-11-15T21:47:23.097ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22102024-11-15T21:47:23.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22112024-11-15T21:47:23.098ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22122024-11-15T21:47:23.098ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
22132024-11-15T21:47:23.098ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
22142024-11-15T21:47:23.098ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.995382ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
22152024-11-15T21:47:23.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.672506ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22162024-11-15T21:47:23.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22172024-11-15T21:47:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22182024-11-15T21:47:23.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22192024-11-15T21:47:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22202024-11-15T21:47:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22212024-11-15T21:47:23.103ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22222024-11-15T21:47:23.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22232024-11-15T21:47:23.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22242024-11-15T21:47:23.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
22252024-11-15T21:47:23.106ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22262024-11-15T21:47:23.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22272024-11-15T21:47:23.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22282024-11-15T21:47:23.111ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
22292024-11-15T21:47:23.111ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
22302024-11-15T21:47:23.111ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
22312024-11-15T21:47:23.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22322024-11-15T21:47:23.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22332024-11-15T21:47:23.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22342024-11-15T21:47:23.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
22352024-11-15T21:47:23.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22362024-11-15T21:47:23.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22372024-11-15T21:47:23.115ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.091632ms iteration = 11 status = 0
22382024-11-15T21:47:23.116ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22392024-11-15T21:47:23.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22402024-11-15T21:47:23.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22412024-11-15T21:47:23.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22422024-11-15T21:47:23.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22432024-11-15T21:47:23.119ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22442024-11-15T21:47:23.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22452024-11-15T21:47:23.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22462024-11-15T21:47:23.128ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22472024-11-15T21:47:23.128ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22482024-11-15T21:47:23.128ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.823495ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22492024-11-15T21:47:23.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22502024-11-15T21:47:23.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22512024-11-15T21:47:23.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22522024-11-15T21:47:23.132ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22532024-11-15T21:47:23.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22542024-11-15T21:47:23.133ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.940108ms iteration = 14 status = {"physical_disks_added":0}
22552024-11-15T21:47:23.134ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22562024-11-15T21:47:23.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22572024-11-15T21:47:23.135ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22582024-11-15T21:47:23.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22592024-11-15T21:47:23.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22602024-11-15T21:47:23.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
22612024-11-15T21:47:23.141ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22622024-11-15T21:47:23.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22632024-11-15T21:47:23.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22642024-11-15T21:47:23.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22652024-11-15T21:47:23.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22662024-11-15T21:47:23.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22672024-11-15T21:47:23.149ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
22682024-11-15T21:47:23.149ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
22692024-11-15T21:47:23.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22702024-11-15T21:47:23.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22712024-11-15T21:47:23.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22722024-11-15T21:47:23.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22732024-11-15T21:47:23.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22742024-11-15T21:47:23.151ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
22752024-11-15T21:47:23.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22762024-11-15T21:47:23.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22772024-11-15T21:47:23.153ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22782024-11-15T21:47:23.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22792024-11-15T21:47:23.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22802024-11-15T21:47:23.155ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22812024-11-15T21:47:23.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22822024-11-15T21:47:23.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22832024-11-15T21:47:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22842024-11-15T21:47:23.157ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22852024-11-15T21:47:23.159ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
22862024-11-15T21:47:23.159ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
22872024-11-15T21:47:23.159ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
22882024-11-15T21:47:23.159ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 148.923056ms iteration = 7 status = {"generation":2}
22892024-11-15T21:47:23.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22902024-11-15T21:47:23.160ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22912024-11-15T21:47:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22922024-11-15T21:47:23.167ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
22932024-11-15T21:47:23.167ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
22942024-11-15T21:47:23.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22952024-11-15T21:47:23.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22962024-11-15T21:47:23.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22972024-11-15T21:47:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22982024-11-15T21:47:23.257ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
22992024-11-15T21:47:23.257ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 247.397406ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
23002024-11-15T21:47:23.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
23012024-11-15T21:47:23.282ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23022024-11-15T21:47:23.283ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "79e5fc7d-5203-4726-b409-fa8593aa911e", "content-length": "26", "date": "Fri, 15 Nov 2024 21:47:22 GMT"} })
23032024-11-15T21:47:23.283ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23042024-11-15T21:47:23.285ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23052024-11-15T21:47:23.297ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23062024-11-15T21:47:23.335ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
23072024-11-15T21:47:23.335ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23082024-11-15T21:47:23.336ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4bbdfbc-659e-4bf9-9669-87e572bc4145", "content-length": "26", "date": "Fri, 15 Nov 2024 21:47:22 GMT"} })
23092024-11-15T21:47:23.336ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23102024-11-15T21:47:23.338ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23112024-11-15T21:47:23.340ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
23122024-11-15T21:47:23.340ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23132024-11-15T21:47:23.341ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef54c5c1-03db-4e79-82d7-a1ab5a06e4fa", "content-length": "26", "date": "Fri, 15 Nov 2024 21:47:22 GMT"} })
23142024-11-15T21:47:23.341ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23152024-11-15T21:47:23.342ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
23162024-11-15T21:47:23.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cc286104-9497-462e-a46f-bf1f6768593b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
23172024-11-15T21:47:23.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cc286104-9497-462e-a46f-bf1f6768593b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
23182024-11-15T21:47:23.470ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 459.648143ms iteration = 11 status = {}
23192024-11-15T21:47:23.495ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23202024-11-15T21:47:23.525ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
23212024-11-15T21:47:23.525ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f824ad87-b354-4ac3-b4af-fc00ec8d8481", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23222024-11-15T21:47:23.525ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23232024-11-15T21:47:23.529ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3c9f907d-d116-4062-9c56-24f8ca5e09f8", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23242024-11-15T21:47:23.529ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23252024-11-15T21:47:23.531ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23262024-11-15T21:47:23.531ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 520.955332ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23272024-11-15T21:47:23.534ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23282024-11-15T21:47:23.534ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23292024-11-15T21:47:23.535ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "067f8252-cfbb-4095-98dd-19f1aa04a8c2", "content-length": "372", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
23302024-11-15T21:47:23.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23312024-11-15T21:47:23.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23322024-11-15T21:47:23.537ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23332024-11-15T21:47:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23342024-11-15T21:47:23.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23352024-11-15T21:47:23.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cc286104-9497-462e-a46f-bf1f6768593b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
23362024-11-15T21:47:23.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23372024-11-15T21:47:23.541ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23382024-11-15T21:47:23.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23392024-11-15T21:47:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23402024-11-15T21:47:23.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
23412024-11-15T21:47:23.544ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23422024-11-15T21:47:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23432024-11-15T21:47:23.546ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23442024-11-15T21:47:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23452024-11-15T21:47:23.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23462024-11-15T21:47:23.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23472024-11-15T21:47:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23482024-11-15T21:47:23.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23492024-11-15T21:47:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23502024-11-15T21:47:23.576ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23512024-11-15T21:47:23.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23522024-11-15T21:47:23.576ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
23532024-11-15T21:47:23.576ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 565.790283ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
23542024-11-15T21:47:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23552024-11-15T21:47:23.578ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
23562024-11-15T21:47:23.578ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23572024-11-15T21:47:23.578ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
23582024-11-15T21:47:23.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 567.968437ms iteration = 7 status = {"generation":1}
23592024-11-15T21:47:23.580ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23602024-11-15T21:47:23.580ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "572380c6-7212-43f3-b8ff-293c7ca0911b", "content-length": "1", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
23612024-11-15T21:47:23.580ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23622024-11-15T21:47:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23632024-11-15T21:47:23.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23642024-11-15T21:47:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23652024-11-15T21:47:23.583ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 573.635023ms iteration = 11 status = null
23662024-11-15T21:47:23.585ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
23672024-11-15T21:47:23.585ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23682024-11-15T21:47:23.586ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "004e7aff-52e0-41e9-8cab-7f7c3bc74013", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
23692024-11-15T21:47:23.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23702024-11-15T21:47:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23712024-11-15T21:47:23.586ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23722024-11-15T21:47:23.587ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "da95ad62-4830-4cab-8f1e-89bc4c2d40b0", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23732024-11-15T21:47:23.587ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23742024-11-15T21:47:23.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23752024-11-15T21:47:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23762024-11-15T21:47:23.588ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "80586231-28b0-4f64-93c2-3095fbdac820", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23772024-11-15T21:47:23.588ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23782024-11-15T21:47:23.590ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1f9c3fc1-ab93-40fd-80d4-b20786c888c8", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23792024-11-15T21:47:23.590ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23802024-11-15T21:47:23.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23812024-11-15T21:47:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23822024-11-15T21:47:23.592ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23832024-11-15T21:47:23.592ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 582.036618ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
23842024-11-15T21:47:23.594ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23852024-11-15T21:47:23.594ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23862024-11-15T21:47:23.594ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8380e632-623a-4b2b-88cf-45bada4afe36", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
23872024-11-15T21:47:23.595ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 585.59179ms iteration = 12 status = {}
23882024-11-15T21:47:23.609ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23892024-11-15T21:47:23.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
23902024-11-15T21:47:23.612ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23912024-11-15T21:47:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23922024-11-15T21:47:23.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23932024-11-15T21:47:23.621ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23942024-11-15T21:47:23.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23952024-11-15T21:47:23.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23962024-11-15T21:47:23.623ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23972024-11-15T21:47:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23982024-11-15T21:47:23.624ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
23992024-11-15T21:47:23.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24002024-11-15T21:47:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24012024-11-15T21:47:23.626ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24022024-11-15T21:47:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24032024-11-15T21:47:23.628ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24042024-11-15T21:47:23.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24052024-11-15T21:47:23.630ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24062024-11-15T21:47:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24072024-11-15T21:47:23.632ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24082024-11-15T21:47:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24092024-11-15T21:47:23.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24102024-11-15T21:47:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24112024-11-15T21:47:23.634ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24122024-11-15T21:47:23.635ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbb8a32b-de50-4ebb-b61a-774fb2668b45", "content-length": "134", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
24132024-11-15T21:47:23.635ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24142024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24152024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
24162024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24172024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24182024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24192024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24202024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24212024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24222024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24232024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24242024-11-15T21:47:23.635ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
24252024-11-15T21:47:23.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24262024-11-15T21:47:23.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24272024-11-15T21:47:23.638ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24282024-11-15T21:47:23.638ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4814d2de-a9a0-4842-b98d-4fc84436cf19", "content-length": "2", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
24292024-11-15T21:47:23.638ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24302024-11-15T21:47:23.638ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c8ac12b-df73-4703-a5ad-d51339616ec9", "content-length": "52", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
24312024-11-15T21:47:23.638ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
24322024-11-15T21:47:23.638ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24332024-11-15T21:47:23.638ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
24342024-11-15T21:47:23.638ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24352024-11-15T21:47:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24362024-11-15T21:47:23.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24372024-11-15T21:47:23.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24382024-11-15T21:47:23.641ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24392024-11-15T21:47:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24402024-11-15T21:47:23.642ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24412024-11-15T21:47:23.645ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
24422024-11-15T21:47:23.645ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24432024-11-15T21:47:23.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24442024-11-15T21:47:23.651ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
24452024-11-15T21:47:23.651ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24462024-11-15T21:47:23.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24472024-11-15T21:47:23.653ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24482024-11-15T21:47:23.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
24492024-11-15T21:47:23.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24502024-11-15T21:47:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24512024-11-15T21:47:23.657ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
24522024-11-15T21:47:23.657ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
24532024-11-15T21:47:23.657ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
24542024-11-15T21:47:23.672ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24552024-11-15T21:47:23.722ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bcc8b4bd-45b7-4736-935b-4cfecdfbc285", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
24562024-11-15T21:47:23.722ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
24572024-11-15T21:47:23.722ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24582024-11-15T21:47:23.723ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "96f6a6b9-5608-4339-9254-cb3f3876f54e", "content-length": "691", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
24592024-11-15T21:47:23.723ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
24602024-11-15T21:47:23.723ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
24612024-11-15T21:47:23.723ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
24622024-11-15T21:47:23.723ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "898a78cf-7c38-4af6-ba6e-d981148bbf3d", "content-length": "682", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
24632024-11-15T21:47:23.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24642024-11-15T21:47:23.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24652024-11-15T21:47:23.724ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 713.951724ms iteration = 11 status = {}
24662024-11-15T21:47:23.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24672024-11-15T21:47:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24682024-11-15T21:47:23.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24692024-11-15T21:47:23.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24702024-11-15T21:47:23.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24712024-11-15T21:47:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24722024-11-15T21:47:23.739ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 729.442055ms iteration = 11 status = {}
24732024-11-15T21:47:23.799ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 78d47478-5af8-488d-89c5-11be23443b63, time_created: 2024-11-15T21:42:21.206118Z, time_modified: 2024-11-15T21:42:21.206118Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
24742024-11-15T21:47:23.799ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
24752024-11-15T21:47:23.799ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24762024-11-15T21:47:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24772024-11-15T21:47:23.802ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24782024-11-15T21:47:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24792024-11-15T21:47:23.804ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24802024-11-15T21:47:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
24812024-11-15T21:47:23.837ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24822024-11-15T21:47:23.838ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3ebf668b-e786-49c6-bd10-92a1cb10ef15", "date": "Fri, 15 Nov 2024 21:47:23 GMT"} })
24832024-11-15T21:47:23.838ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
24842024-11-15T21:47:23.838ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 828.463697ms
24852024-11-15T21:47:23.838ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 828.472797ms iteration = 2 status = {}
24862024-11-15T21:47:23.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = a7643010-d152-4b86-8fbe-35c0295748cf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
24872024-11-15T21:47:23.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = a7643010-d152-4b86-8fbe-35c0295748cf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
24882024-11-15T21:47:23.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = a7643010-d152-4b86-8fbe-35c0295748cf response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
24892024-11-15T21:47:24.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e12501b4-dfc5-4dc7-8491-0b626761ae0a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
24902024-11-15T21:47:24.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e12501b4-dfc5-4dc7-8491-0b626761ae0a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
24912024-11-15T21:47:24.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e12501b4-dfc5-4dc7-8491-0b626761ae0a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
24922024-11-15T21:47:25.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7a423ef-252e-4b8d-9b0a-8b806c9af4fd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
24932024-11-15T21:47:25.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7a423ef-252e-4b8d-9b0a-8b806c9af4fd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
24942024-11-15T21:47:25.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7a423ef-252e-4b8d-9b0a-8b806c9af4fd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
24952024-11-15T21:47:26.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 828bd28c-9a1a-46f7-86e3-5707b6721c32 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
24962024-11-15T21:47:26.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 828bd28c-9a1a-46f7-86e3-5707b6721c32 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
24972024-11-15T21:47:26.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 828bd28c-9a1a-46f7-86e3-5707b6721c32 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
24982024-11-15T21:47:26.955ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
24992024-11-15T21:47:26.955ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
25002024-11-15T21:47:26.986ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
25012024-11-15T21:47:26.986ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36257
25022024-11-15T21:47:26.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36257 req_id = f4fa05ad-05c1-4d9c-b486-bb10a9121140 roles = RoleSet { roles: {} } uri = /metrics/producers
25032024-11-15T21:47:26.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36257 req_id = f4fa05ad-05c1-4d9c-b486-bb10a9121140 resource = Database result = Ok(()) uri = /metrics/producers
25042024-11-15T21:47:27.025ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
25052024-11-15T21:47:27.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39388 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36257 req_id = f4fa05ad-05c1-4d9c-b486-bb10a9121140 response_code = 201 uri = /metrics/producers
25062024-11-15T21:47:27.025ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f4fa05ad-05c1-4d9c-b486-bb10a9121140", "content-length": "41", "date": "Fri, 15 Nov 2024 21:47:26 GMT"} })
25072024-11-15T21:47:27.027ZDEBGnexus (producer-registration-task): registered with nexus successfully
25082024-11-15T21:47:27.027ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
25092024-11-15T21:47:27.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d00ed5c6-02e1-48b3-a80d-46d712c32b97 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25102024-11-15T21:47:27.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d00ed5c6-02e1-48b3-a80d-46d712c32b97 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25112024-11-15T21:47:27.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d00ed5c6-02e1-48b3-a80d-46d712c32b97 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25122024-11-15T21:47:28.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 63d595e3-3165-493c-9e66-d608a737873a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25132024-11-15T21:47:28.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 63d595e3-3165-493c-9e66-d608a737873a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25142024-11-15T21:47:28.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 63d595e3-3165-493c-9e66-d608a737873a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25152024-11-15T21:47:29.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3500687-407a-412f-bbea-f75914bbc11c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25162024-11-15T21:47:29.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3500687-407a-412f-bbea-f75914bbc11c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25172024-11-15T21:47:29.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3500687-407a-412f-bbea-f75914bbc11c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25182024-11-15T21:47:30.648ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1509 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = f7377820-178b-463b-8670-8724fcf7f9ca response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
25192024-11-15T21:47:30.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b1071cdc-538e-4687-8228-94af0ec449da roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25202024-11-15T21:47:30.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b1071cdc-538e-4687-8228-94af0ec449da resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25212024-11-15T21:47:30.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b1071cdc-538e-4687-8228-94af0ec449da response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25222024-11-15T21:47:31.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 57b09d24-d8cb-4936-a34d-4bb6ea98ae06 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25232024-11-15T21:47:31.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 57b09d24-d8cb-4936-a34d-4bb6ea98ae06 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25242024-11-15T21:47:31.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 57b09d24-d8cb-4936-a34d-4bb6ea98ae06 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25252024-11-15T21:47:32.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a65d829f-f8e1-4a99-a4af-fcb661efce90 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25262024-11-15T21:47:32.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a65d829f-f8e1-4a99-a4af-fcb661efce90 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25272024-11-15T21:47:32.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a65d829f-f8e1-4a99-a4af-fcb661efce90 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25282024-11-15T21:47:33.007ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
25292024-11-15T21:47:33.007ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
25302024-11-15T21:47:33.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25312024-11-15T21:47:33.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25322024-11-15T21:47:33.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25332024-11-15T21:47:33.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25342024-11-15T21:47:33.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25352024-11-15T21:47:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25362024-11-15T21:47:33.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25372024-11-15T21:47:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25382024-11-15T21:47:33.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25392024-11-15T21:47:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25402024-11-15T21:47:33.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25412024-11-15T21:47:33.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
25422024-11-15T21:47:33.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25432024-11-15T21:47:33.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25442024-11-15T21:47:33.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
25452024-11-15T21:47:33.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.138793ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
25462024-11-15T21:47:33.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25472024-11-15T21:47:33.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25482024-11-15T21:47:33.069ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.095713ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25492024-11-15T21:47:33.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad73f3b5-c11a-444b-a03a-fda911b7cd53 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25502024-11-15T21:47:33.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad73f3b5-c11a-444b-a03a-fda911b7cd53 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25512024-11-15T21:47:33.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad73f3b5-c11a-444b-a03a-fda911b7cd53 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25522024-11-15T21:47:34.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cf52fc0f-bea3-4bfa-a4a1-392d603fd7de roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25532024-11-15T21:47:34.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cf52fc0f-bea3-4bfa-a4a1-392d603fd7de resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25542024-11-15T21:47:34.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cf52fc0f-bea3-4bfa-a4a1-392d603fd7de response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25552024-11-15T21:47:35.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = ddb8359d-c5e7-47a9-97c3-10dded433212 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
25562024-11-15T21:47:35.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = ddb8359d-c5e7-47a9-97c3-10dded433212 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
25572024-11-15T21:47:35.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = ddb8359d-c5e7-47a9-97c3-10dded433212 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
25582024-11-15T21:47:35.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = f1dcfff7-d209-48bb-8165-8d704c9deb20 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
25592024-11-15T21:47:35.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = f1dcfff7-d209-48bb-8165-8d704c9deb20 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
25602024-11-15T21:47:35.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = f1dcfff7-d209-48bb-8165-8d704c9deb20 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
25612024-11-15T21:47:35.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 327d11d6-2273-4c4a-876b-f51f250d90ac roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25622024-11-15T21:47:35.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 327d11d6-2273-4c4a-876b-f51f250d90ac resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25632024-11-15T21:47:35.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 327d11d6-2273-4c4a-876b-f51f250d90ac response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25642024-11-15T21:47:36.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 537445d2-fd5f-4172-b8ad-4cf833a63156 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25652024-11-15T21:47:36.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 537445d2-fd5f-4172-b8ad-4cf833a63156 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25662024-11-15T21:47:36.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 537445d2-fd5f-4172-b8ad-4cf833a63156 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25672024-11-15T21:47:37.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = acfb8100-73b2-47ed-b248-d8fb1bf6043b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25682024-11-15T21:47:37.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = acfb8100-73b2-47ed-b248-d8fb1bf6043b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25692024-11-15T21:47:37.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = acfb8100-73b2-47ed-b248-d8fb1bf6043b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25702024-11-15T21:47:38.721ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:32768
25712024-11-15T21:47:38.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32768 req_id = bc39eec0-f450-49d2-8a02-310220dbec23 roles = RoleSet { roles: {} } uri = /metrics/producers
25722024-11-15T21:47:38.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32768 req_id = bc39eec0-f450-49d2-8a02-310220dbec23 resource = Database result = Ok(()) uri = /metrics/producers
25732024-11-15T21:47:38.769ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 5e8fa613-d1c4-416c-8557-742a109ff40b
25742024-11-15T21:47:38.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47859 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32768 req_id = bc39eec0-f450-49d2-8a02-310220dbec23 response_code = 201 uri = /metrics/producers
25752024-11-15T21:47:38.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b21eb2fa-a875-4123-97a4-6e1d4a3041e4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25762024-11-15T21:47:38.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b21eb2fa-a875-4123-97a4-6e1d4a3041e4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25772024-11-15T21:47:38.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b21eb2fa-a875-4123-97a4-6e1d4a3041e4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25782024-11-15T21:47:39.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ffdfc03e-ae70-4dbb-a54d-bf6d9445cb8d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25792024-11-15T21:47:39.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ffdfc03e-ae70-4dbb-a54d-bf6d9445cb8d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25802024-11-15T21:47:39.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ffdfc03e-ae70-4dbb-a54d-bf6d9445cb8d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25812024-11-15T21:47:40.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 82a7cc3d-7ceb-4922-a84d-6bd5535d13d8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25822024-11-15T21:47:40.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 82a7cc3d-7ceb-4922-a84d-6bd5535d13d8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25832024-11-15T21:47:40.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 82a7cc3d-7ceb-4922-a84d-6bd5535d13d8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25842024-11-15T21:47:41.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7748ba25-b1c9-423a-915c-ab85f4933b30 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25852024-11-15T21:47:41.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7748ba25-b1c9-423a-915c-ab85f4933b30 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25862024-11-15T21:47:41.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7748ba25-b1c9-423a-915c-ab85f4933b30 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25872024-11-15T21:47:42.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6a8580b4-c8b6-4406-82ce-a3da0f2d48c2 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25882024-11-15T21:47:42.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6a8580b4-c8b6-4406-82ce-a3da0f2d48c2 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25892024-11-15T21:47:42.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6a8580b4-c8b6-4406-82ce-a3da0f2d48c2 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
25902024-11-15T21:47:43.005ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
25912024-11-15T21:47:43.005ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
25922024-11-15T21:47:43.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25932024-11-15T21:47:43.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25942024-11-15T21:47:43.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25952024-11-15T21:47:43.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25962024-11-15T21:47:43.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25972024-11-15T21:47:43.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25982024-11-15T21:47:43.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25992024-11-15T21:47:43.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26002024-11-15T21:47:43.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26012024-11-15T21:47:43.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26022024-11-15T21:47:43.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26032024-11-15T21:47:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
26042024-11-15T21:47:43.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26052024-11-15T21:47:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26062024-11-15T21:47:43.031ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
26072024-11-15T21:47:43.031ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.952859ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
26082024-11-15T21:47:43.039ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26092024-11-15T21:47:43.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26102024-11-15T21:47:43.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.443465ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26112024-11-15T21:47:43.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b59e6295-bbc8-4151-91ef-e226e676818c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26122024-11-15T21:47:43.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b59e6295-bbc8-4151-91ef-e226e676818c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26132024-11-15T21:47:43.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b59e6295-bbc8-4151-91ef-e226e676818c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26142024-11-15T21:47:44.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 643073f1-b10a-42ec-9020-6ab0cc38b522 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26152024-11-15T21:47:44.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 643073f1-b10a-42ec-9020-6ab0cc38b522 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26162024-11-15T21:47:44.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 643073f1-b10a-42ec-9020-6ab0cc38b522 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26172024-11-15T21:47:45.646ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1405 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 42feb105-90b8-4784-80eb-eb315ea94886 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
26182024-11-15T21:47:46.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9831e3ab-d15a-4da8-87e3-a96fde8d4f69 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26192024-11-15T21:47:46.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9831e3ab-d15a-4da8-87e3-a96fde8d4f69 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26202024-11-15T21:47:46.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9831e3ab-d15a-4da8-87e3-a96fde8d4f69 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26212024-11-15T21:47:46.792ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:38940
26222024-11-15T21:47:46.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38940 req_id = c039ffa0-2265-4684-8707-5f18c700d1f9 roles = RoleSet { roles: {} } uri = /metrics/producers
26232024-11-15T21:47:46.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38940 req_id = c039ffa0-2265-4684-8707-5f18c700d1f9 resource = Database result = Ok(()) uri = /metrics/producers
26242024-11-15T21:47:46.839ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 78d47478-5af8-488d-89c5-11be23443b63
26252024-11-15T21:47:46.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46872 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38940 req_id = c039ffa0-2265-4684-8707-5f18c700d1f9 response_code = 201 uri = /metrics/producers
26262024-11-15T21:47:47.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 74d779fd-a6ae-4702-b1b8-a69404ea612f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26272024-11-15T21:47:47.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 74d779fd-a6ae-4702-b1b8-a69404ea612f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26282024-11-15T21:47:47.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 74d779fd-a6ae-4702-b1b8-a69404ea612f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26292024-11-15T21:47:48.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2e6de102-2ebd-4f78-ab31-31a9b49571a5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26302024-11-15T21:47:48.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2e6de102-2ebd-4f78-ab31-31a9b49571a5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26312024-11-15T21:47:48.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2e6de102-2ebd-4f78-ab31-31a9b49571a5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26322024-11-15T21:47:49.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 08f2869d-964c-4f6a-ad38-9c0cf22db84b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26332024-11-15T21:47:49.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 08f2869d-964c-4f6a-ad38-9c0cf22db84b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26342024-11-15T21:47:49.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 08f2869d-964c-4f6a-ad38-9c0cf22db84b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26352024-11-15T21:47:50.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c298a4cb-3ced-4476-88bc-d96eba13371c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26362024-11-15T21:47:50.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c298a4cb-3ced-4476-88bc-d96eba13371c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26372024-11-15T21:47:50.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c298a4cb-3ced-4476-88bc-d96eba13371c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26382024-11-15T21:47:51.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0c1ff5a1-d005-464a-8878-02df5d30af23 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26392024-11-15T21:47:51.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0c1ff5a1-d005-464a-8878-02df5d30af23 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26402024-11-15T21:47:51.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0c1ff5a1-d005-464a-8878-02df5d30af23 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26412024-11-15T21:47:52.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 37124894-b806-4dfc-92fd-daa45ccb2e7c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26422024-11-15T21:47:52.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 37124894-b806-4dfc-92fd-daa45ccb2e7c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26432024-11-15T21:47:52.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 37124894-b806-4dfc-92fd-daa45ccb2e7c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
26442024-11-15T21:47:53.002ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
26452024-11-15T21:47:53.002ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
26462024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26472024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26482024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
26492024-11-15T21:47:53.003ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26502024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
26512024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26522024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26532024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
26542024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26552024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
26562024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
26572024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26582024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
26592024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
26602024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
26612024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26622024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26632024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
26642024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26652024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26662024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
26672024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26682024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
26692024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26702024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26712024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
26722024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26732024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
26742024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26752024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
26762024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26772024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
26782024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26792024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26802024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26812024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26822024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26832024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26842024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26852024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26862024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26872024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26882024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26892024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26902024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26912024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26922024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26932024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26942024-11-15T21:47:53.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26952024-11-15T21:47:53.005ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26962024-11-15T21:47:53.005ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.936079ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26972024-11-15T21:47:53.005ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26982024-11-15T21:47:53.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26992024-11-15T21:47:53.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27002024-11-15T21:47:53.007ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27012024-11-15T21:47:53.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27022024-11-15T21:47:53.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27032024-11-15T21:47:53.008ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27042024-11-15T21:47:53.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27052024-11-15T21:47:53.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27062024-11-15T21:47:53.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27072024-11-15T21:47:53.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27082024-11-15T21:47:53.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27092024-11-15T21:47:53.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27102024-11-15T21:47:53.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27112024-11-15T21:47:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27122024-11-15T21:47:53.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 985108604 } })
27132024-11-15T21:47:53.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27142024-11-15T21:47:53.015ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
27152024-11-15T21:47:53.017ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 987123228 } })
27162024-11-15T21:47:53.017ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
27172024-11-15T21:47:53.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27182024-11-15T21:47:53.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27192024-11-15T21:47:53.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27202024-11-15T21:47:53.024ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27212024-11-15T21:47:53.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27222024-11-15T21:47:53.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27232024-11-15T21:47:53.026ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 996633469 } })
27242024-11-15T21:47:53.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
27252024-11-15T21:47:53.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27262024-11-15T21:47:53.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27272024-11-15T21:47:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27282024-11-15T21:47:53.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27292024-11-15T21:47:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27302024-11-15T21:47:53.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27312024-11-15T21:47:53.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27322024-11-15T21:47:53.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27332024-11-15T21:47:53.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27342024-11-15T21:47:53.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27352024-11-15T21:47:53.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27362024-11-15T21:47:53.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.328635ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
27372024-11-15T21:47:53.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27382024-11-15T21:47:53.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27392024-11-15T21:47:53.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27402024-11-15T21:47:53.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27412024-11-15T21:47:53.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27422024-11-15T21:47:53.065ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27432024-11-15T21:47:53.065ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27442024-11-15T21:47:53.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27452024-11-15T21:47:53.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27462024-11-15T21:47:53.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27472024-11-15T21:47:53.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.602146ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
27482024-11-15T21:47:53.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27492024-11-15T21:47:53.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27502024-11-15T21:47:53.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27512024-11-15T21:47:53.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27522024-11-15T21:47:53.070ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27532024-11-15T21:47:53.070ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.420407ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27542024-11-15T21:47:53.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27552024-11-15T21:47:53.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27562024-11-15T21:47:53.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27572024-11-15T21:47:53.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
27582024-11-15T21:47:53.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27592024-11-15T21:47:53.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27602024-11-15T21:47:53.076ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27612024-11-15T21:47:53.076ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27622024-11-15T21:47:53.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27632024-11-15T21:47:53.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27642024-11-15T21:47:53.078ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.082857ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27652024-11-15T21:47:53.079ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27662024-11-15T21:47:53.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27672024-11-15T21:47:53.081ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27682024-11-15T21:47:53.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
27692024-11-15T21:47:53.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27702024-11-15T21:47:53.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27712024-11-15T21:47:53.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.771594ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27722024-11-15T21:47:53.087ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.71313ms iteration = 12 status = 0
27732024-11-15T21:47:53.088ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
27742024-11-15T21:47:53.088ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.205393ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
27752024-11-15T21:47:53.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 93.201265ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27762024-11-15T21:47:53.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
27772024-11-15T21:47:53.103ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27782024-11-15T21:47:53.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
27792024-11-15T21:47:53.103ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27802024-11-15T21:47:53.104ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4affb85b-6c95-456f-9418-40dcf3333acc", "content-length": "26", "date": "Fri, 15 Nov 2024 21:47:52 GMT"} })
27812024-11-15T21:47:53.104ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27822024-11-15T21:47:53.104ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1362cf82-3b79-455e-9da2-e3137ea1d308", "content-length": "26", "date": "Fri, 15 Nov 2024 21:47:52 GMT"} })
27832024-11-15T21:47:53.104ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27842024-11-15T21:47:53.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27852024-11-15T21:47:53.106ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27862024-11-15T21:47:53.106ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27872024-11-15T21:47:53.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27882024-11-15T21:47:53.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27892024-11-15T21:47:53.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27902024-11-15T21:47:53.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 104.200616ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27912024-11-15T21:47:53.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
27922024-11-15T21:47:53.112ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27932024-11-15T21:47:53.113ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bc26ebe-dd0a-4644-8f81-0cc713225812", "content-length": "26", "date": "Fri, 15 Nov 2024 21:47:52 GMT"} })
27942024-11-15T21:47:53.113ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27952024-11-15T21:47:53.115ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
27962024-11-15T21:47:53.139ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27972024-11-15T21:47:53.140ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27982024-11-15T21:47:53.140ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.921789ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27992024-11-15T21:47:53.145ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 142.508734ms iteration = 15 status = {"physical_disks_added":0}
28002024-11-15T21:47:53.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28012024-11-15T21:47:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28022024-11-15T21:47:53.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = daf7b5ce-409b-4140-8e88-1680dce2ad2d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
28032024-11-15T21:47:53.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = daf7b5ce-409b-4140-8e88-1680dce2ad2d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
28042024-11-15T21:47:53.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = daf7b5ce-409b-4140-8e88-1680dce2ad2d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
28052024-11-15T21:47:53.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28062024-11-15T21:47:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28072024-11-15T21:47:53.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28082024-11-15T21:47:53.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28092024-11-15T21:47:53.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28102024-11-15T21:47:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28112024-11-15T21:47:53.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28122024-11-15T21:47:53.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28132024-11-15T21:47:53.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28142024-11-15T21:47:53.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28152024-11-15T21:47:53.268ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28162024-11-15T21:47:53.268ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28172024-11-15T21:47:53.269ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca7995d8-97ed-40f8-b94c-249001785a73", "content-length": "372", "date": "Fri, 15 Nov 2024 21:47:53 GMT"} })
28182024-11-15T21:47:53.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28192024-11-15T21:47:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28202024-11-15T21:47:53.317ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
28212024-11-15T21:47:53.317ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28222024-11-15T21:47:53.317ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bd437979-d4ef-456b-8030-cb8ed8e52617", "date": "Fri, 15 Nov 2024 21:47:53 GMT"} })
28232024-11-15T21:47:53.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28242024-11-15T21:47:53.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28252024-11-15T21:47:53.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28262024-11-15T21:47:53.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28272024-11-15T21:47:53.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28282024-11-15T21:47:53.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28292024-11-15T21:47:53.327ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28302024-11-15T21:47:53.327ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28312024-11-15T21:47:53.328ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "45659bbd-86cc-4b19-ab79-24ff337f68dd", "date": "Fri, 15 Nov 2024 21:47:53 GMT"} })
28322024-11-15T21:47:53.329ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 326.69312ms iteration = 13 status = {}
28332024-11-15T21:47:53.406ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28342024-11-15T21:47:53.407ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ccbdf3c-707e-4f22-a462-ef040862bb7e", "content-length": "1", "date": "Fri, 15 Nov 2024 21:47:52 GMT"} })
28352024-11-15T21:47:53.408ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28362024-11-15T21:47:53.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28372024-11-15T21:47:53.412ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 409.389687ms iteration = 12 status = null
28382024-11-15T21:47:53.429ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 426.79414ms iteration = 12 status = {}
28392024-11-15T21:47:53.441ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28402024-11-15T21:47:53.441ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8ee43af-6fb8-4899-94f6-e2b2ed923af3", "content-length": "691", "date": "Fri, 15 Nov 2024 21:47:53 GMT"} })
28412024-11-15T21:47:53.441ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
28422024-11-15T21:47:53.441ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
28432024-11-15T21:47:53.441ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
28442024-11-15T21:47:53.444ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 441.039173ms iteration = 12 status = {}
28452024-11-15T21:47:53.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28462024-11-15T21:47:53.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28472024-11-15T21:47:53.496ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
28482024-11-15T21:47:53.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28492024-11-15T21:47:53.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28502024-11-15T21:47:53.506ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28512024-11-15T21:47:53.506ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4eb68eb-6612-4182-ac7a-1a58794a08ee", "content-length": "134", "date": "Fri, 15 Nov 2024 21:47:52 GMT"} })
28522024-11-15T21:47:53.506ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28532024-11-15T21:47:53.506ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
28542024-11-15T21:47:53.506ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28552024-11-15T21:47:53.506ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28562024-11-15T21:47:53.506ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28572024-11-15T21:47:53.506ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28582024-11-15T21:47:53.506ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28592024-11-15T21:47:53.506ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28602024-11-15T21:47:53.506ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28612024-11-15T21:47:53.506ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28622024-11-15T21:47:53.507ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
28632024-11-15T21:47:53.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28642024-11-15T21:47:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28652024-11-15T21:47:53.509ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28662024-11-15T21:47:53.509ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdd79039-ebf0-4ea9-928b-f1fa8f8d4a43", "content-length": "2", "date": "Fri, 15 Nov 2024 21:47:52 GMT"} })
28672024-11-15T21:47:53.509ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28682024-11-15T21:47:53.509ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "36efef99-7624-4086-84b0-48b1592513d1", "content-length": "52", "date": "Fri, 15 Nov 2024 21:47:52 GMT"} })
28692024-11-15T21:47:53.509ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
28702024-11-15T21:47:53.509ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28712024-11-15T21:47:53.605ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7923fc16-a751-41f9-96d0-f67562d35b3e", "date": "Fri, 15 Nov 2024 21:47:53 GMT"} })
28722024-11-15T21:47:53.605ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
28732024-11-15T21:47:53.605ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28742024-11-15T21:47:53.605ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "48a9b16c-b40d-4ea3-88c8-d6afbeb458cd", "content-length": "682", "date": "Fri, 15 Nov 2024 21:47:53 GMT"} })
28752024-11-15T21:47:53.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28762024-11-15T21:47:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28772024-11-15T21:47:53.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28782024-11-15T21:47:53.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28792024-11-15T21:47:53.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28802024-11-15T21:47:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28812024-11-15T21:47:53.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28822024-11-15T21:47:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28832024-11-15T21:47:53.623ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 620.769749ms iteration = 12 status = {}
28842024-11-15T21:47:53.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 826366f9-3711-49fd-ae20-35e755b156bf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
28852024-11-15T21:47:53.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 826366f9-3711-49fd-ae20-35e755b156bf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
28862024-11-15T21:47:53.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 826366f9-3711-49fd-ae20-35e755b156bf response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
28872024-11-15T21:47:54.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fc959764-7ea2-45ae-a73e-3adaf1fe69f8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
28882024-11-15T21:47:54.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fc959764-7ea2-45ae-a73e-3adaf1fe69f8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
28892024-11-15T21:47:54.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fc959764-7ea2-45ae-a73e-3adaf1fe69f8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
28902024-11-15T21:47:54.701ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55641
28912024-11-15T21:47:54.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55641 req_id = a83ed955-d1d7-44e9-a184-10691fea806c roles = RoleSet { roles: {} } uri = /metrics/producers
28922024-11-15T21:47:54.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55641 req_id = a83ed955-d1d7-44e9-a184-10691fea806c resource = Database result = Ok(()) uri = /metrics/producers
28932024-11-15T21:47:54.712ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 17a6b664-61ae-47e8-9c94-fdc7e3f8e300
28942024-11-15T21:47:54.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11171 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55641 req_id = a83ed955-d1d7-44e9-a184-10691fea806c response_code = 201 uri = /metrics/producers
28952024-11-15T21:47:54.865ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50644
28962024-11-15T21:47:54.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50644 req_id = 07e4fcbc-48bc-4edb-ab19-73901f763bf2 roles = RoleSet { roles: {} } uri = /metrics/producers
28972024-11-15T21:47:54.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50644 req_id = 07e4fcbc-48bc-4edb-ab19-73901f763bf2 resource = Database result = Ok(()) uri = /metrics/producers
28982024-11-15T21:47:54.899ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 1ee9a34a-c3be-49f8-8ccd-8456768402b0
28992024-11-15T21:47:54.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33608 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50644 req_id = 07e4fcbc-48bc-4edb-ab19-73901f763bf2 response_code = 201 uri = /metrics/producers
29002024-11-15T21:47:55.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 170a9767-900c-4d48-9fa7-9acc30d4a735 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29012024-11-15T21:47:55.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 170a9767-900c-4d48-9fa7-9acc30d4a735 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29022024-11-15T21:47:55.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 170a9767-900c-4d48-9fa7-9acc30d4a735 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29032024-11-15T21:47:56.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4a6a8675-afd6-48b6-b066-7c476c19f96e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29042024-11-15T21:47:56.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4a6a8675-afd6-48b6-b066-7c476c19f96e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29052024-11-15T21:47:56.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4a6a8675-afd6-48b6-b066-7c476c19f96e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29062024-11-15T21:47:57.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cf2b587c-9db5-4a07-a848-518044ba5c70 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29072024-11-15T21:47:57.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cf2b587c-9db5-4a07-a848-518044ba5c70 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29082024-11-15T21:47:57.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1663 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cf2b587c-9db5-4a07-a848-518044ba5c70 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29092024-11-15T21:47:58.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 954e47ab-bfa9-452a-a901-4ac37e2a7321 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29102024-11-15T21:47:58.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 954e47ab-bfa9-452a-a901-4ac37e2a7321 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29112024-11-15T21:47:58.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 954e47ab-bfa9-452a-a901-4ac37e2a7321 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29122024-11-15T21:47:59.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dabadc2e-5978-4125-9c54-b275ddb719f8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29132024-11-15T21:47:59.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dabadc2e-5978-4125-9c54-b275ddb719f8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29142024-11-15T21:47:59.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dabadc2e-5978-4125-9c54-b275ddb719f8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29152024-11-15T21:48:00.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 16951628-6153-4e6e-92c2-da8685bab53e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29162024-11-15T21:48:00.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 16951628-6153-4e6e-92c2-da8685bab53e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29172024-11-15T21:48:00.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 16951628-6153-4e6e-92c2-da8685bab53e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29182024-11-15T21:48:00.644ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1435 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 7d817107-617a-4d79-81f3-ed7600134017 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
29192024-11-15T21:48:01.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 414bf544-f6ee-4300-8b69-cdec4cf147b7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29202024-11-15T21:48:01.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 414bf544-f6ee-4300-8b69-cdec4cf147b7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29212024-11-15T21:48:01.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 414bf544-f6ee-4300-8b69-cdec4cf147b7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29222024-11-15T21:48:02.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cdc5b3b0-ff59-429d-8b94-b370fd84b1c0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29232024-11-15T21:48:02.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cdc5b3b0-ff59-429d-8b94-b370fd84b1c0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29242024-11-15T21:48:02.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cdc5b3b0-ff59-429d-8b94-b370fd84b1c0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29252024-11-15T21:48:03.005ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
29262024-11-15T21:48:03.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29272024-11-15T21:48:03.005ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
29282024-11-15T21:48:03.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29292024-11-15T21:48:03.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29302024-11-15T21:48:03.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29312024-11-15T21:48:03.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29322024-11-15T21:48:03.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29332024-11-15T21:48:03.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29342024-11-15T21:48:03.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.134557ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29352024-11-15T21:48:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29362024-11-15T21:48:03.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29372024-11-15T21:48:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29382024-11-15T21:48:03.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29392024-11-15T21:48:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29402024-11-15T21:48:03.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29412024-11-15T21:48:03.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
29422024-11-15T21:48:03.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29432024-11-15T21:48:03.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29442024-11-15T21:48:03.056ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
29452024-11-15T21:48:03.056ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.365687ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
29462024-11-15T21:48:03.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 77897f2f-6193-419f-97aa-4972de96421e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29472024-11-15T21:48:03.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 77897f2f-6193-419f-97aa-4972de96421e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29482024-11-15T21:48:03.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 77897f2f-6193-419f-97aa-4972de96421e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29492024-11-15T21:48:04.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3aa227f4-c05f-47cc-ab19-3dfeae848709 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29502024-11-15T21:48:04.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3aa227f4-c05f-47cc-ab19-3dfeae848709 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29512024-11-15T21:48:04.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3aa227f4-c05f-47cc-ab19-3dfeae848709 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29522024-11-15T21:48:05.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9c729302-32a9-4753-8577-f7d9dbe66c0c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29532024-11-15T21:48:05.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9c729302-32a9-4753-8577-f7d9dbe66c0c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29542024-11-15T21:48:05.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9c729302-32a9-4753-8577-f7d9dbe66c0c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29552024-11-15T21:48:05.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = aefad925-6ef6-4d38-a39a-a1ef4d51353d roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
29562024-11-15T21:48:05.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = aefad925-6ef6-4d38-a39a-a1ef4d51353d resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
29572024-11-15T21:48:05.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = aefad925-6ef6-4d38-a39a-a1ef4d51353d response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
29582024-11-15T21:48:05.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 1528fd28-989b-44da-a14f-b43769197167 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
29592024-11-15T21:48:05.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 1528fd28-989b-44da-a14f-b43769197167 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
29602024-11-15T21:48:05.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 1528fd28-989b-44da-a14f-b43769197167 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
29612024-11-15T21:48:06.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1f73c1cb-a273-4bb1-b304-8b7589079188 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29622024-11-15T21:48:06.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1f73c1cb-a273-4bb1-b304-8b7589079188 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29632024-11-15T21:48:06.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1f73c1cb-a273-4bb1-b304-8b7589079188 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29642024-11-15T21:48:07.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 48ba5e52-1065-4b4a-9a0e-2f07d78c6bd1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29652024-11-15T21:48:07.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 48ba5e52-1065-4b4a-9a0e-2f07d78c6bd1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29662024-11-15T21:48:07.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 48ba5e52-1065-4b4a-9a0e-2f07d78c6bd1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29672024-11-15T21:48:08.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 057f2481-4104-41e7-a7af-db548f642273 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29682024-11-15T21:48:08.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 057f2481-4104-41e7-a7af-db548f642273 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29692024-11-15T21:48:08.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 057f2481-4104-41e7-a7af-db548f642273 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29702024-11-15T21:48:09.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8a4f49ef-4b56-4e9b-abf3-852dd71ff0ce roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29712024-11-15T21:48:09.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8a4f49ef-4b56-4e9b-abf3-852dd71ff0ce resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29722024-11-15T21:48:09.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1862 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8a4f49ef-4b56-4e9b-abf3-852dd71ff0ce response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29732024-11-15T21:48:10.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b8e9bc3c-f00f-439f-b7e7-f2d43652446d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29742024-11-15T21:48:10.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b8e9bc3c-f00f-439f-b7e7-f2d43652446d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29752024-11-15T21:48:10.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b8e9bc3c-f00f-439f-b7e7-f2d43652446d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29762024-11-15T21:48:11.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2e29025f-fad4-4e60-9728-2b3ed195b67a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29772024-11-15T21:48:11.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2e29025f-fad4-4e60-9728-2b3ed195b67a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29782024-11-15T21:48:11.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2e29025f-fad4-4e60-9728-2b3ed195b67a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29792024-11-15T21:48:12.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4c2552ab-c20b-4396-8db0-dfbd1f529fa4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29802024-11-15T21:48:12.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4c2552ab-c20b-4396-8db0-dfbd1f529fa4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29812024-11-15T21:48:12.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4c2552ab-c20b-4396-8db0-dfbd1f529fa4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
29822024-11-15T21:48:13.019ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
29832024-11-15T21:48:13.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29842024-11-15T21:48:13.019ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
29852024-11-15T21:48:13.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29862024-11-15T21:48:13.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29872024-11-15T21:48:13.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29882024-11-15T21:48:13.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29892024-11-15T21:48:13.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29902024-11-15T21:48:13.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.805126ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29912024-11-15T21:48:13.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29922024-11-15T21:48:13.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29932024-11-15T21:48:13.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29942024-11-15T21:48:13.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29952024-11-15T21:48:13.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29962024-11-15T21:48:13.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29972024-11-15T21:48:13.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29982024-11-15T21:48:13.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
29992024-11-15T21:48:13.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30002024-11-15T21:48:13.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30012024-11-15T21:48:13.075ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
30022024-11-15T21:48:13.075ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.42491ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
30032024-11-15T21:48:13.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f4675d27-f1d5-412c-bb93-8042c68ed02a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30042024-11-15T21:48:13.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f4675d27-f1d5-412c-bb93-8042c68ed02a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30052024-11-15T21:48:13.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f4675d27-f1d5-412c-bb93-8042c68ed02a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30062024-11-15T21:48:14.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a3529a18-a7e5-4f28-af55-470e26f388ee roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30072024-11-15T21:48:14.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a3529a18-a7e5-4f28-af55-470e26f388ee resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30082024-11-15T21:48:14.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a3529a18-a7e5-4f28-af55-470e26f388ee response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30092024-11-15T21:48:15.439ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:59468
30102024-11-15T21:48:15.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59468 req_id = d3f71891-f842-4bcc-ab93-f37b68c5c9ba roles = RoleSet { roles: {} } uri = /metrics/producers
30112024-11-15T21:48:15.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59468 req_id = d3f71891-f842-4bcc-ab93-f37b68c5c9ba resource = Database result = Ok(()) uri = /metrics/producers
30122024-11-15T21:48:15.450ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 97598fa2-4ef4-4fda-9111-75c99f8284f6
30132024-11-15T21:48:15.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10831 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59468 req_id = d3f71891-f842-4bcc-ab93-f37b68c5c9ba response_code = 201 uri = /metrics/producers
30142024-11-15T21:48:15.660ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1369 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = d0bb2894-a21f-4fbd-9eb1-b771e39e30b9 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
30152024-11-15T21:48:15.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2224661f-af1b-42f2-b3b6-ec1255bd8312 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30162024-11-15T21:48:15.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2224661f-af1b-42f2-b3b6-ec1255bd8312 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30172024-11-15T21:48:15.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2224661f-af1b-42f2-b3b6-ec1255bd8312 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30182024-11-15T21:48:16.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 058def2f-cae5-4336-9c35-ea0b1806ea4e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30192024-11-15T21:48:16.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 058def2f-cae5-4336-9c35-ea0b1806ea4e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30202024-11-15T21:48:16.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 058def2f-cae5-4336-9c35-ea0b1806ea4e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30212024-11-15T21:48:17.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 723aec72-f5f2-4307-a809-f20e184a0e7b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30222024-11-15T21:48:17.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 723aec72-f5f2-4307-a809-f20e184a0e7b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30232024-11-15T21:48:17.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 723aec72-f5f2-4307-a809-f20e184a0e7b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30242024-11-15T21:48:18.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 335b0dc8-d63e-4de9-a185-a48fd9df3160 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30252024-11-15T21:48:18.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 335b0dc8-d63e-4de9-a185-a48fd9df3160 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30262024-11-15T21:48:18.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 335b0dc8-d63e-4de9-a185-a48fd9df3160 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30272024-11-15T21:48:19.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d158c36d-fb03-4dc3-b34e-f0c8a384f9e7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30282024-11-15T21:48:19.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d158c36d-fb03-4dc3-b34e-f0c8a384f9e7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30292024-11-15T21:48:19.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d158c36d-fb03-4dc3-b34e-f0c8a384f9e7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30302024-11-15T21:48:20.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e56e6ef0-744e-411e-b7a3-76d3890d6b2b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30312024-11-15T21:48:20.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e56e6ef0-744e-411e-b7a3-76d3890d6b2b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30322024-11-15T21:48:20.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e56e6ef0-744e-411e-b7a3-76d3890d6b2b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30332024-11-15T21:48:21.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 88484524-a3f5-4fc3-9063-2e4bbddd3fda roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30342024-11-15T21:48:21.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 88484524-a3f5-4fc3-9063-2e4bbddd3fda resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30352024-11-15T21:48:21.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 88484524-a3f5-4fc3-9063-2e4bbddd3fda response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30362024-11-15T21:48:22.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f6d89dad-4e7b-4c63-9735-a990592f6d40 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30372024-11-15T21:48:22.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f6d89dad-4e7b-4c63-9735-a990592f6d40 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30382024-11-15T21:48:22.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f6d89dad-4e7b-4c63-9735-a990592f6d40 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
30392024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
30402024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30412024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
30422024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
30432024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
30442024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30452024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
30462024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30472024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
30482024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30492024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
30502024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30512024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
30522024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30532024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
30542024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30552024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
30562024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
30572024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30582024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30592024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
30602024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30612024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
30622024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
30632024-11-15T21:48:23.018ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:38:23.018721324 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30642024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30652024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
30662024-11-15T21:48:23.018ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30672024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
30682024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30692024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30702024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
30712024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30722024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30732024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
30742024-11-15T21:48:23.018ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
30752024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.55\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
30762024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
30772024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30782024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
30792024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
30802024-11-15T21:48:23.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30812024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
30822024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30832024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
30842024-11-15T21:48:23.019ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30852024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
30862024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30872024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30882024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
30892024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30902024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
30912024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30922024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30932024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
30942024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30952024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
30962024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
30972024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30982024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30992024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
31002024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31012024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
31022024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31032024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31042024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31052024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31062024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31072024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31082024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31092024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31102024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31112024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31122024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31132024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31142024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31152024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31162024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31172024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31182024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31192024-11-15T21:48:23.019ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 973869891 } })
31202024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31212024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31222024-11-15T21:48:23.019ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 973878400 } })
31232024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31242024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31252024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31262024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31272024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31282024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31292024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31302024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31312024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31322024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31332024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31342024-11-15T21:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31352024-11-15T21:48:23.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31362024-11-15T21:48:23.020ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
31372024-11-15T21:48:23.020ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31382024-11-15T21:48:23.020ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.294638ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
31392024-11-15T21:48:23.020ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
31402024-11-15T21:48:23.020ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.54055ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
31412024-11-15T21:48:23.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31422024-11-15T21:48:23.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31432024-11-15T21:48:23.023ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31442024-11-15T21:48:23.023ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.553779ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31452024-11-15T21:48:23.023ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31462024-11-15T21:48:23.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31472024-11-15T21:48:23.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31482024-11-15T21:48:23.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31492024-11-15T21:48:23.024ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.506126ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
31502024-11-15T21:48:23.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31512024-11-15T21:48:23.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31522024-11-15T21:48:23.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31532024-11-15T21:48:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31542024-11-15T21:48:23.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31552024-11-15T21:48:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31562024-11-15T21:48:23.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31572024-11-15T21:48:23.027ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:38:23.018721324 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
31582024-11-15T21:48:23.027ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.158709ms iteration = 7 status = {"expiration":"2024-11-15T21:38:23.018721324Z","pruned":[]}
31592024-11-15T21:48:23.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31602024-11-15T21:48:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31612024-11-15T21:48:23.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31622024-11-15T21:48:23.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 983036870 } })
31632024-11-15T21:48:23.028ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
31642024-11-15T21:48:23.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31652024-11-15T21:48:23.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31662024-11-15T21:48:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31672024-11-15T21:48:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31682024-11-15T21:48:23.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31692024-11-15T21:48:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31702024-11-15T21:48:23.035ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 989656643 } })
31712024-11-15T21:48:23.035ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
31722024-11-15T21:48:23.036ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31732024-11-15T21:48:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31742024-11-15T21:48:23.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31752024-11-15T21:48:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31762024-11-15T21:48:23.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31772024-11-15T21:48:23.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31782024-11-15T21:48:23.046ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31792024-11-15T21:48:23.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31802024-11-15T21:48:23.050ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 4535950 } })
31812024-11-15T21:48:23.050ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
31822024-11-15T21:48:23.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31832024-11-15T21:48:23.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31842024-11-15T21:48:23.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31852024-11-15T21:48:23.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31862024-11-15T21:48:23.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31872024-11-15T21:48:23.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31882024-11-15T21:48:23.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31892024-11-15T21:48:23.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31902024-11-15T21:48:23.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31912024-11-15T21:48:23.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31922024-11-15T21:48:23.079ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.206571ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
31932024-11-15T21:48:23.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31942024-11-15T21:48:23.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31952024-11-15T21:48:23.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31962024-11-15T21:48:23.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31972024-11-15T21:48:23.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31982024-11-15T21:48:23.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.357555ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
31992024-11-15T21:48:23.082ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32002024-11-15T21:48:23.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32012024-11-15T21:48:23.082ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32022024-11-15T21:48:23.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32032024-11-15T21:48:23.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32042024-11-15T21:48:23.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32052024-11-15T21:48:23.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32062024-11-15T21:48:23.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32072024-11-15T21:48:23.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082024-11-15T21:48:23.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32092024-11-15T21:48:23.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32102024-11-15T21:48:23.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32112024-11-15T21:48:23.087ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
32122024-11-15T21:48:23.087ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
32132024-11-15T21:48:23.088ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.072848ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
32142024-11-15T21:48:23.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32152024-11-15T21:48:23.088ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32162024-11-15T21:48:23.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32172024-11-15T21:48:23.089ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32182024-11-15T21:48:23.090ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32192024-11-15T21:48:23.090ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32202024-11-15T21:48:23.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32212024-11-15T21:48:23.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32222024-11-15T21:48:23.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32232024-11-15T21:48:23.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32242024-11-15T21:48:23.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32252024-11-15T21:48:23.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32262024-11-15T21:48:23.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32272024-11-15T21:48:23.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32282024-11-15T21:48:23.092ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32292024-11-15T21:48:23.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32302024-11-15T21:48:23.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32312024-11-15T21:48:23.099ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32322024-11-15T21:48:23.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32332024-11-15T21:48:23.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32342024-11-15T21:48:23.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.421561ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32352024-11-15T21:48:23.104ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32362024-11-15T21:48:23.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
32372024-11-15T21:48:23.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32382024-11-15T21:48:23.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32392024-11-15T21:48:23.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32402024-11-15T21:48:23.108ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32412024-11-15T21:48:23.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32422024-11-15T21:48:23.109ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432024-11-15T21:48:23.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32442024-11-15T21:48:23.111ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32452024-11-15T21:48:23.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32462024-11-15T21:48:23.112ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32472024-11-15T21:48:23.114ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32482024-11-15T21:48:23.114ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32492024-11-15T21:48:23.114ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32502024-11-15T21:48:23.114ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32512024-11-15T21:48:23.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32522024-11-15T21:48:23.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32532024-11-15T21:48:23.115ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32542024-11-15T21:48:23.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32552024-11-15T21:48:23.119ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32562024-11-15T21:48:23.119ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 100.660283ms iteration = 4 status = {"nsuccess":5}
32572024-11-15T21:48:23.122ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32582024-11-15T21:48:23.122ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 104.321448ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32592024-11-15T21:48:23.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32602024-11-15T21:48:23.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32612024-11-15T21:48:23.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32622024-11-15T21:48:23.138ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32632024-11-15T21:48:23.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32642024-11-15T21:48:23.139ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
32652024-11-15T21:48:23.139ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 120.699334ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
32662024-11-15T21:48:23.143ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32672024-11-15T21:48:23.144ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32682024-11-15T21:48:23.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32692024-11-15T21:48:23.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32702024-11-15T21:48:23.150ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
32712024-11-15T21:48:23.150ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
32722024-11-15T21:48:23.150ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
32732024-11-15T21:48:23.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32742024-11-15T21:48:23.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32752024-11-15T21:48:23.153ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32762024-11-15T21:48:23.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32772024-11-15T21:48:23.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32782024-11-15T21:48:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32792024-11-15T21:48:23.158ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32802024-11-15T21:48:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32812024-11-15T21:48:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
32822024-11-15T21:48:23.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32832024-11-15T21:48:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32842024-11-15T21:48:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32852024-11-15T21:48:23.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32862024-11-15T21:48:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32872024-11-15T21:48:23.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 143.996345ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
32882024-11-15T21:48:23.163ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32892024-11-15T21:48:23.163ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32902024-11-15T21:48:23.163ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32912024-11-15T21:48:23.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32922024-11-15T21:48:23.164ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 145.971848ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32932024-11-15T21:48:23.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32942024-11-15T21:48:23.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32952024-11-15T21:48:23.166ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.643619ms iteration = 13 status = 0
32962024-11-15T21:48:23.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32972024-11-15T21:48:23.173ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
32982024-11-15T21:48:23.173ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 154.827255ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
32992024-11-15T21:48:23.174ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33002024-11-15T21:48:23.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33012024-11-15T21:48:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33022024-11-15T21:48:23.178ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33032024-11-15T21:48:23.180ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33042024-11-15T21:48:23.180ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33052024-11-15T21:48:23.180ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 161.515249ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33062024-11-15T21:48:23.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33072024-11-15T21:48:23.181ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33082024-11-15T21:48:23.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33092024-11-15T21:48:23.191ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33102024-11-15T21:48:23.191ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
33112024-11-15T21:48:23.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33122024-11-15T21:48:23.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33132024-11-15T21:48:23.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33142024-11-15T21:48:23.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33152024-11-15T21:48:23.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33162024-11-15T21:48:23.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33172024-11-15T21:48:23.199ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
33182024-11-15T21:48:23.199ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33192024-11-15T21:48:23.199ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
33202024-11-15T21:48:23.199ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 180.787694ms iteration = 8 status = {"generation":2}
33212024-11-15T21:48:23.203ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
33222024-11-15T21:48:23.203ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33232024-11-15T21:48:23.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 185.385553ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
33242024-11-15T21:48:23.204ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c017c2d2-218d-4f89-a107-c293b1df39dd", "content-length": "26", "date": "Fri, 15 Nov 2024 21:48:22 GMT"} })
33252024-11-15T21:48:23.204ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33262024-11-15T21:48:23.205ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33272024-11-15T21:48:23.212ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33282024-11-15T21:48:23.212ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33292024-11-15T21:48:23.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33302024-11-15T21:48:23.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33312024-11-15T21:48:23.219ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33322024-11-15T21:48:23.219ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33332024-11-15T21:48:23.219ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 200.909914ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33342024-11-15T21:48:23.227ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33352024-11-15T21:48:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33362024-11-15T21:48:23.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33372024-11-15T21:48:23.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33382024-11-15T21:48:23.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33392024-11-15T21:48:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33402024-11-15T21:48:23.254ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33412024-11-15T21:48:23.279ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 260.860393ms iteration = 16 status = {"physical_disks_added":0}
33422024-11-15T21:48:23.281ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33432024-11-15T21:48:23.360ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
33442024-11-15T21:48:23.360ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33452024-11-15T21:48:23.360ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f311de13-8507-4925-9068-4f72f9d15685", "content-length": "26", "date": "Fri, 15 Nov 2024 21:48:22 GMT"} })
33462024-11-15T21:48:23.360ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33472024-11-15T21:48:23.361ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33482024-11-15T21:48:23.378ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33492024-11-15T21:48:23.379ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bb38bdc-0aa9-4e46-8d74-68933fdadd1a", "content-length": "1", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} })
33502024-11-15T21:48:23.381ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33512024-11-15T21:48:23.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33522024-11-15T21:48:23.384ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
33532024-11-15T21:48:23.384ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33542024-11-15T21:48:23.384ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8401de7-1f12-4413-aa69-6b1d5ae554cc", "content-length": "26", "date": "Fri, 15 Nov 2024 21:48:22 GMT"} })
33552024-11-15T21:48:23.384ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33562024-11-15T21:48:23.386ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
33572024-11-15T21:48:23.391ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33582024-11-15T21:48:23.391ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33592024-11-15T21:48:23.391ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "797c72cb-bbe2-4a93-8ed1-ea6db1a2fd2a", "content-length": "372", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} })
33602024-11-15T21:48:23.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33612024-11-15T21:48:23.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33622024-11-15T21:48:23.393ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33632024-11-15T21:48:23.394ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 376.067782ms iteration = 13 status = null
33642024-11-15T21:48:23.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33652024-11-15T21:48:23.395ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33662024-11-15T21:48:23.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33672024-11-15T21:48:23.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33682024-11-15T21:48:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33692024-11-15T21:48:23.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33702024-11-15T21:48:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33712024-11-15T21:48:23.435ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33722024-11-15T21:48:23.435ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33732024-11-15T21:48:23.435ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
33742024-11-15T21:48:23.435ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 416.770435ms iteration = 8 status = {"generation":1}
33752024-11-15T21:48:23.439ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
33762024-11-15T21:48:23.439ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 420.774271ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33772024-11-15T21:48:23.447ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
33782024-11-15T21:48:23.447ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33792024-11-15T21:48:23.447ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "575a97b1-11e6-4e92-86b3-6213e9bb9e26", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} })
33802024-11-15T21:48:23.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33812024-11-15T21:48:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33822024-11-15T21:48:23.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33832024-11-15T21:48:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33842024-11-15T21:48:23.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33852024-11-15T21:48:23.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33862024-11-15T21:48:23.458ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33872024-11-15T21:48:23.458ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33882024-11-15T21:48:23.458ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d1a80202-fe7e-405a-87bc-3e090a22ab04", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} })
33892024-11-15T21:48:23.460ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 441.450235ms iteration = 14 status = {}
33902024-11-15T21:48:23.480ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33912024-11-15T21:48:23.481ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7d19b64c-fffb-4bc2-a467-680c040241b3", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33922024-11-15T21:48:23.481ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33932024-11-15T21:48:23.482ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b0aa2ad3-e706-4fe8-9015-4868c3de7e50", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33942024-11-15T21:48:23.482ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33952024-11-15T21:48:23.484ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33962024-11-15T21:48:23.484ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 466.371217ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33972024-11-15T21:48:23.496ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 477.55082ms iteration = 13 status = {}
33982024-11-15T21:48:23.509ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33992024-11-15T21:48:23.564ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34002024-11-15T21:48:23.565ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "10451328-f9ac-4dc6-8975-8cfcb21ada6b", "content-length": "691", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} })
34012024-11-15T21:48:23.565ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
34022024-11-15T21:48:23.565ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
34032024-11-15T21:48:23.565ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
34042024-11-15T21:48:23.567ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 548.334289ms iteration = 13 status = {}
34052024-11-15T21:48:23.657ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34062024-11-15T21:48:23.658ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0ba3e8dc-c7c9-476e-8487-c4fcfdfcbf9c", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34072024-11-15T21:48:23.658ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34082024-11-15T21:48:23.659ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d555dc01-9092-447e-8b1c-af7bd9f16b2e", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34092024-11-15T21:48:23.659ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34102024-11-15T21:48:23.661ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d0cb1940-4f46-4ff8-ab27-6b1985f0ddad", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34112024-11-15T21:48:23.661ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34122024-11-15T21:48:23.662ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34132024-11-15T21:48:23.662ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 644.301612ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34142024-11-15T21:48:23.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34152024-11-15T21:48:23.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34162024-11-15T21:48:23.707ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
34172024-11-15T21:48:23.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34182024-11-15T21:48:23.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34192024-11-15T21:48:23.716ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34202024-11-15T21:48:23.717ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2efc0c95-459b-42c2-ba91-d360f7334bf3", "content-length": "134", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} })
34212024-11-15T21:48:23.717ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34222024-11-15T21:48:23.717ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
34232024-11-15T21:48:23.717ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34242024-11-15T21:48:23.717ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34252024-11-15T21:48:23.717ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34262024-11-15T21:48:23.717ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34272024-11-15T21:48:23.717ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34282024-11-15T21:48:23.717ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34292024-11-15T21:48:23.717ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34302024-11-15T21:48:23.717ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34312024-11-15T21:48:23.718ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
34322024-11-15T21:48:23.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34332024-11-15T21:48:23.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34342024-11-15T21:48:23.719ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34352024-11-15T21:48:23.719ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a66a441a-d49f-4c15-b3cf-bb5a009ff23d", "content-length": "2", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} })
34362024-11-15T21:48:23.719ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34372024-11-15T21:48:23.720ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "76e936ae-ad42-4209-bc20-9982e981e20f", "content-length": "52", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} })
34382024-11-15T21:48:23.720ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
34392024-11-15T21:48:23.720ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34402024-11-15T21:48:23.816ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c914099f-62a0-460c-b1d2-9de8d9003403", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} })
34412024-11-15T21:48:23.816ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
34422024-11-15T21:48:23.816ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
34432024-11-15T21:48:23.816ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "67d94e54-f9c8-4bd3-b744-0e552ece9f41", "content-length": "682", "date": "Fri, 15 Nov 2024 21:48:23 GMT"} })
34442024-11-15T21:48:23.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34452024-11-15T21:48:23.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34462024-11-15T21:48:23.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34472024-11-15T21:48:23.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34482024-11-15T21:48:23.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34492024-11-15T21:48:23.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34502024-11-15T21:48:23.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34512024-11-15T21:48:23.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34522024-11-15T21:48:23.833ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 815.09338ms iteration = 13 status = {}
34532024-11-15T21:48:23.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 81b525ba-ae94-4450-b6b6-4119743cb5ad roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34542024-11-15T21:48:23.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 81b525ba-ae94-4450-b6b6-4119743cb5ad resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34552024-11-15T21:48:23.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 81b525ba-ae94-4450-b6b6-4119743cb5ad response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34562024-11-15T21:48:23.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 0dc46364-ebfe-47b4-b35f-1ca660a363e1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
34572024-11-15T21:48:23.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 0dc46364-ebfe-47b4-b35f-1ca660a363e1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
34582024-11-15T21:48:23.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 0dc46364-ebfe-47b4-b35f-1ca660a363e1 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
34592024-11-15T21:48:24.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7a00502e-9b7b-4b11-9d56-0eb2db4deb20 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34602024-11-15T21:48:24.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7a00502e-9b7b-4b11-9d56-0eb2db4deb20 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34612024-11-15T21:48:24.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7a00502e-9b7b-4b11-9d56-0eb2db4deb20 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34622024-11-15T21:48:25.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 868a9ba6-0db8-47e0-9185-f87fd2c9d541 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34632024-11-15T21:48:25.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 868a9ba6-0db8-47e0-9185-f87fd2c9d541 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34642024-11-15T21:48:25.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 868a9ba6-0db8-47e0-9185-f87fd2c9d541 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34652024-11-15T21:48:26.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eab42aad-e7f3-4f0e-9c97-46750a4a6bb1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34662024-11-15T21:48:26.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eab42aad-e7f3-4f0e-9c97-46750a4a6bb1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34672024-11-15T21:48:26.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eab42aad-e7f3-4f0e-9c97-46750a4a6bb1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34682024-11-15T21:48:27.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a8003522-4e4d-4129-b4ca-d55c60a789d7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34692024-11-15T21:48:27.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a8003522-4e4d-4129-b4ca-d55c60a789d7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34702024-11-15T21:48:27.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a8003522-4e4d-4129-b4ca-d55c60a789d7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34712024-11-15T21:48:28.549ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:50604
34722024-11-15T21:48:28.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50604 req_id = e796ac1e-8760-42f3-930b-47f9673b620c roles = RoleSet { roles: {} } uri = /metrics/producers
34732024-11-15T21:48:28.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50604 req_id = e796ac1e-8760-42f3-930b-47f9673b620c resource = Database result = Ok(()) uri = /metrics/producers
34742024-11-15T21:48:28.594ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 54270a8d-942f-4159-a4b4-d6745626c749
34752024-11-15T21:48:28.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44943 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50604 req_id = e796ac1e-8760-42f3-930b-47f9673b620c response_code = 201 uri = /metrics/producers
34762024-11-15T21:48:28.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a9375878-82f5-4695-ae7f-062273a58a79 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34772024-11-15T21:48:28.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a9375878-82f5-4695-ae7f-062273a58a79 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34782024-11-15T21:48:28.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a9375878-82f5-4695-ae7f-062273a58a79 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34792024-11-15T21:48:30.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cbf90c65-979f-4ccd-bd8f-3defb5490444 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34802024-11-15T21:48:30.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cbf90c65-979f-4ccd-bd8f-3defb5490444 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34812024-11-15T21:48:30.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cbf90c65-979f-4ccd-bd8f-3defb5490444 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34822024-11-15T21:48:30.661ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1556 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 41364257-6f4d-4605-bda8-370cc873333b response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
34832024-11-15T21:48:31.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a51d729f-01b7-4939-8651-398530c883a1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34842024-11-15T21:48:31.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a51d729f-01b7-4939-8651-398530c883a1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34852024-11-15T21:48:31.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a51d729f-01b7-4939-8651-398530c883a1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34862024-11-15T21:48:32.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 92944e4b-24f9-4e37-bf56-96661d7cef43 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34872024-11-15T21:48:32.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 92944e4b-24f9-4e37-bf56-96661d7cef43 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34882024-11-15T21:48:32.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 92944e4b-24f9-4e37-bf56-96661d7cef43 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
34892024-11-15T21:48:33.021ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
34902024-11-15T21:48:33.021ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34912024-11-15T21:48:33.021ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
34922024-11-15T21:48:33.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34932024-11-15T21:48:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34942024-11-15T21:48:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34952024-11-15T21:48:33.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34962024-11-15T21:48:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34972024-11-15T21:48:33.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34982024-11-15T21:48:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34992024-11-15T21:48:33.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35002024-11-15T21:48:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35012024-11-15T21:48:33.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35022024-11-15T21:48:33.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35032024-11-15T21:48:33.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35042024-11-15T21:48:33.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
35052024-11-15T21:48:33.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35062024-11-15T21:48:33.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35072024-11-15T21:48:33.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
35082024-11-15T21:48:33.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.754469ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
35092024-11-15T21:48:33.082ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.410859ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35102024-11-15T21:48:33.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1df29139-3492-4f74-92f8-a72488ef45b3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35112024-11-15T21:48:33.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1df29139-3492-4f74-92f8-a72488ef45b3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35122024-11-15T21:48:33.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1df29139-3492-4f74-92f8-a72488ef45b3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35132024-11-15T21:48:34.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7c0c25ad-bf0f-45a2-8f70-52ca0d134f74 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35142024-11-15T21:48:34.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7c0c25ad-bf0f-45a2-8f70-52ca0d134f74 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35152024-11-15T21:48:34.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7c0c25ad-bf0f-45a2-8f70-52ca0d134f74 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35162024-11-15T21:48:35.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 902287df-90e0-45d9-a748-ccf2e7cdea7d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35172024-11-15T21:48:35.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 902287df-90e0-45d9-a748-ccf2e7cdea7d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35182024-11-15T21:48:35.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 902287df-90e0-45d9-a748-ccf2e7cdea7d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35192024-11-15T21:48:36.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a896d8ab-27bc-4885-804f-029d6635fa2a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35202024-11-15T21:48:36.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a896d8ab-27bc-4885-804f-029d6635fa2a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35212024-11-15T21:48:36.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a896d8ab-27bc-4885-804f-029d6635fa2a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35222024-11-15T21:48:37.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ddb2c47-46a3-4618-bb19-a8678fdfc38b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35232024-11-15T21:48:37.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ddb2c47-46a3-4618-bb19-a8678fdfc38b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35242024-11-15T21:48:37.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ddb2c47-46a3-4618-bb19-a8678fdfc38b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35252024-11-15T21:48:38.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 06647ea2-326f-47a4-855b-4a1661adca8f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35262024-11-15T21:48:38.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 06647ea2-326f-47a4-855b-4a1661adca8f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35272024-11-15T21:48:38.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 06647ea2-326f-47a4-855b-4a1661adca8f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35282024-11-15T21:48:39.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fbcd68cd-1c5a-4ae9-89e8-ab87f790f38e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35292024-11-15T21:48:39.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fbcd68cd-1c5a-4ae9-89e8-ab87f790f38e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35302024-11-15T21:48:39.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fbcd68cd-1c5a-4ae9-89e8-ab87f790f38e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35312024-11-15T21:48:40.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1b06fbf-629c-406f-9750-e5218f299e5f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35322024-11-15T21:48:40.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1b06fbf-629c-406f-9750-e5218f299e5f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35332024-11-15T21:48:40.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1b06fbf-629c-406f-9750-e5218f299e5f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35342024-11-15T21:48:41.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca59ef29-2dd7-41e5-97e4-9018635d0b5e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35352024-11-15T21:48:41.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca59ef29-2dd7-41e5-97e4-9018635d0b5e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35362024-11-15T21:48:41.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca59ef29-2dd7-41e5-97e4-9018635d0b5e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35372024-11-15T21:48:42.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b6c1614e-2a84-4fc5-aa41-d74995b32241 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35382024-11-15T21:48:42.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b6c1614e-2a84-4fc5-aa41-d74995b32241 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35392024-11-15T21:48:42.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b6c1614e-2a84-4fc5-aa41-d74995b32241 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35402024-11-15T21:48:43.019ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
35412024-11-15T21:48:43.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35422024-11-15T21:48:43.019ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
35432024-11-15T21:48:43.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35442024-11-15T21:48:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35452024-11-15T21:48:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35462024-11-15T21:48:43.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35472024-11-15T21:48:43.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35482024-11-15T21:48:43.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35492024-11-15T21:48:43.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35502024-11-15T21:48:43.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35512024-11-15T21:48:43.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35522024-11-15T21:48:43.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35532024-11-15T21:48:43.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
35542024-11-15T21:48:43.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35552024-11-15T21:48:43.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35562024-11-15T21:48:43.041ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
35572024-11-15T21:48:43.041ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.146497ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
35582024-11-15T21:48:43.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35592024-11-15T21:48:43.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35602024-11-15T21:48:43.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.240135ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35612024-11-15T21:48:43.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 07c47a57-55b0-4ee8-a8fc-1bc94b1ec9dc roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35622024-11-15T21:48:43.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 07c47a57-55b0-4ee8-a8fc-1bc94b1ec9dc resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35632024-11-15T21:48:43.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 07c47a57-55b0-4ee8-a8fc-1bc94b1ec9dc response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35642024-11-15T21:48:44.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2d26f1a3-ac02-4614-8756-6c62c9734a83 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35652024-11-15T21:48:44.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2d26f1a3-ac02-4614-8756-6c62c9734a83 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35662024-11-15T21:48:44.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2d26f1a3-ac02-4614-8756-6c62c9734a83 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35672024-11-15T21:48:45.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e4a2e34a-ece2-40bf-89fd-fc52256eb9a9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35682024-11-15T21:48:45.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e4a2e34a-ece2-40bf-89fd-fc52256eb9a9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35692024-11-15T21:48:45.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e4a2e34a-ece2-40bf-89fd-fc52256eb9a9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35702024-11-15T21:48:45.662ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1386 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 19a38a65-2f20-46b8-a5fd-0f10ae08abce response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
35712024-11-15T21:48:46.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d39ba6f-c185-445d-be8f-2a789c4a08ba roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35722024-11-15T21:48:46.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d39ba6f-c185-445d-be8f-2a789c4a08ba resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35732024-11-15T21:48:46.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d39ba6f-c185-445d-be8f-2a789c4a08ba response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35742024-11-15T21:48:47.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad4bf44a-d22c-47d1-b80e-635993615888 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35752024-11-15T21:48:47.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad4bf44a-d22c-47d1-b80e-635993615888 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35762024-11-15T21:48:47.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad4bf44a-d22c-47d1-b80e-635993615888 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35772024-11-15T21:48:48.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 23bb6178-b582-4750-934a-18be92cbe044 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35782024-11-15T21:48:48.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 23bb6178-b582-4750-934a-18be92cbe044 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35792024-11-15T21:48:48.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 23bb6178-b582-4750-934a-18be92cbe044 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35802024-11-15T21:48:49.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 02caca97-7e29-4de0-86b2-60667fe171b3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35812024-11-15T21:48:49.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 02caca97-7e29-4de0-86b2-60667fe171b3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35822024-11-15T21:48:49.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 02caca97-7e29-4de0-86b2-60667fe171b3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35832024-11-15T21:48:50.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a445f4d7-b541-431a-9db1-f5da387f3b88 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35842024-11-15T21:48:50.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a445f4d7-b541-431a-9db1-f5da387f3b88 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35852024-11-15T21:48:50.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a445f4d7-b541-431a-9db1-f5da387f3b88 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35862024-11-15T21:48:51.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9ec5f3f4-f52e-467c-ac1c-1be23d76f95f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35872024-11-15T21:48:51.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9ec5f3f4-f52e-467c-ac1c-1be23d76f95f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35882024-11-15T21:48:51.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9ec5f3f4-f52e-467c-ac1c-1be23d76f95f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35892024-11-15T21:48:52.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1aa64a31-918e-4b47-b1c0-3ec352b5040e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35902024-11-15T21:48:52.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1aa64a31-918e-4b47-b1c0-3ec352b5040e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35912024-11-15T21:48:52.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1aa64a31-918e-4b47-b1c0-3ec352b5040e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
35922024-11-15T21:48:53.018ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
35932024-11-15T21:48:53.018ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
35942024-11-15T21:48:53.018ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35952024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35962024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35972024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
35982024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
35992024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36002024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36012024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
36022024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
36032024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36042024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
36052024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36062024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36072024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
36082024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36092024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36102024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
36112024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36122024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
36132024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36142024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
36152024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36162024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
36172024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36182024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
36192024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
36202024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36212024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
36222024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36232024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
36242024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36252024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
36262024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36272024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36282024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36292024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36302024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36312024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36322024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36332024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36342024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36352024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36362024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36372024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36382024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36392024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36402024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36412024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36422024-11-15T21:48:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36432024-11-15T21:48:53.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36442024-11-15T21:48:53.023ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.221647ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
36452024-11-15T21:48:53.023ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 977227303 } })
36462024-11-15T21:48:53.023ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.364218ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36472024-11-15T21:48:53.023ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
36482024-11-15T21:48:53.024ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36492024-11-15T21:48:53.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36502024-11-15T21:48:53.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36512024-11-15T21:48:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36522024-11-15T21:48:53.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36532024-11-15T21:48:53.026ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36542024-11-15T21:48:53.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36552024-11-15T21:48:53.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36562024-11-15T21:48:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36572024-11-15T21:48:53.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36582024-11-15T21:48:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36592024-11-15T21:48:53.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36602024-11-15T21:48:53.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36612024-11-15T21:48:53.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36622024-11-15T21:48:53.035ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 989041230 } })
36632024-11-15T21:48:53.035ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
36642024-11-15T21:48:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36652024-11-15T21:48:53.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36662024-11-15T21:48:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36672024-11-15T21:48:53.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36682024-11-15T21:48:53.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36692024-11-15T21:48:53.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36702024-11-15T21:48:53.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36712024-11-15T21:48:53.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36722024-11-15T21:48:53.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36732024-11-15T21:48:53.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 24.71202ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36742024-11-15T21:48:53.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36752024-11-15T21:48:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36762024-11-15T21:48:53.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36772024-11-15T21:48:53.045ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 998956004 } })
36782024-11-15T21:48:53.045ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
36792024-11-15T21:48:53.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36802024-11-15T21:48:53.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36812024-11-15T21:48:53.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36822024-11-15T21:48:53.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36832024-11-15T21:48:53.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36842024-11-15T21:48:53.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36852024-11-15T21:48:53.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36862024-11-15T21:48:53.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36872024-11-15T21:48:53.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.870288ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
36882024-11-15T21:48:53.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36892024-11-15T21:48:53.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.236733ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36902024-11-15T21:48:53.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36912024-11-15T21:48:53.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36922024-11-15T21:48:53.074ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36932024-11-15T21:48:53.074ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36942024-11-15T21:48:53.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36952024-11-15T21:48:53.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36962024-11-15T21:48:53.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36972024-11-15T21:48:53.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36982024-11-15T21:48:53.079ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36992024-11-15T21:48:53.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37002024-11-15T21:48:53.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37012024-11-15T21:48:53.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37022024-11-15T21:48:53.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37032024-11-15T21:48:53.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37042024-11-15T21:48:53.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37052024-11-15T21:48:53.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37062024-11-15T21:48:53.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
37072024-11-15T21:48:53.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37082024-11-15T21:48:53.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37092024-11-15T21:48:53.094ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37102024-11-15T21:48:53.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37112024-11-15T21:48:53.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37122024-11-15T21:48:53.102ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
37132024-11-15T21:48:53.102ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37142024-11-15T21:48:53.102ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d21167a-1d02-4a4d-accd-6d63dae9ddae", "content-length": "26", "date": "Fri, 15 Nov 2024 21:48:52 GMT"} })
37152024-11-15T21:48:53.102ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37162024-11-15T21:48:53.104ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37172024-11-15T21:48:53.111ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
37182024-11-15T21:48:53.111ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.068444ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
37192024-11-15T21:48:53.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.765021ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
37202024-11-15T21:48:53.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37212024-11-15T21:48:53.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37222024-11-15T21:48:53.122ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37232024-11-15T21:48:53.122ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37242024-11-15T21:48:53.122ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37252024-11-15T21:48:53.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37262024-11-15T21:48:53.125ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
37272024-11-15T21:48:53.125ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37282024-11-15T21:48:53.126ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da56da5b-5152-42ce-b293-2c5ef9ce12c8", "content-length": "26", "date": "Fri, 15 Nov 2024 21:48:52 GMT"} })
37292024-11-15T21:48:53.126ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37302024-11-15T21:48:53.129ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37312024-11-15T21:48:53.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37322024-11-15T21:48:53.134ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37332024-11-15T21:48:53.134ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.337538ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37342024-11-15T21:48:53.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
37352024-11-15T21:48:53.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37362024-11-15T21:48:53.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37372024-11-15T21:48:53.138ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.495516ms iteration = 14 status = 0
37382024-11-15T21:48:53.147ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
37392024-11-15T21:48:53.147ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37402024-11-15T21:48:53.147ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "492f5bee-5c69-4292-99f1-af92fa222ec4", "content-length": "26", "date": "Fri, 15 Nov 2024 21:48:52 GMT"} })
37412024-11-15T21:48:53.147ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37422024-11-15T21:48:53.149ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
37432024-11-15T21:48:53.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 140.944675ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
37442024-11-15T21:48:53.162ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37452024-11-15T21:48:53.162ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 143.706302ms iteration = 17 status = {"physical_disks_added":0}
37462024-11-15T21:48:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37472024-11-15T21:48:53.168ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37482024-11-15T21:48:53.168ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37492024-11-15T21:48:53.168ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.794312ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37502024-11-15T21:48:53.196ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37512024-11-15T21:48:53.196ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea922ea2-3735-49ec-b9a7-4ab0e9a0d339", "content-length": "1", "date": "Fri, 15 Nov 2024 21:48:52 GMT"} })
37522024-11-15T21:48:53.198ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37532024-11-15T21:48:53.198ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37542024-11-15T21:48:53.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37552024-11-15T21:48:53.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37562024-11-15T21:48:53.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37572024-11-15T21:48:53.200ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.981041ms iteration = 14 status = null
37582024-11-15T21:48:53.202ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37592024-11-15T21:48:53.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37602024-11-15T21:48:53.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37612024-11-15T21:48:53.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37622024-11-15T21:48:53.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37632024-11-15T21:48:53.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37642024-11-15T21:48:53.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37652024-11-15T21:48:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 197.645223ms iteration = 14 status = {}
37662024-11-15T21:48:53.249ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37672024-11-15T21:48:53.249ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37682024-11-15T21:48:53.256ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebd0f17b-7e17-412b-a2dc-835d39b7c9ef", "content-length": "372", "date": "Fri, 15 Nov 2024 21:48:52 GMT"} })
37692024-11-15T21:48:53.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37702024-11-15T21:48:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37712024-11-15T21:48:53.297ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37722024-11-15T21:48:53.297ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37732024-11-15T21:48:53.301ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b3fced05-53ba-4774-be17-397a15cfe1e1", "date": "Fri, 15 Nov 2024 21:48:53 GMT"} })
37742024-11-15T21:48:53.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37752024-11-15T21:48:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37762024-11-15T21:48:53.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37772024-11-15T21:48:53.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37782024-11-15T21:48:53.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37792024-11-15T21:48:53.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37802024-11-15T21:48:53.329ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37812024-11-15T21:48:53.329ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "49fffe20-5561-4a6c-88bc-1b0c1bbd003e", "content-length": "691", "date": "Fri, 15 Nov 2024 21:48:53 GMT"} })
37822024-11-15T21:48:53.329ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37832024-11-15T21:48:53.329ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37842024-11-15T21:48:53.329ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37852024-11-15T21:48:53.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37862024-11-15T21:48:53.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37872024-11-15T21:48:53.331ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 312.185407ms iteration = 14 status = {}
37882024-11-15T21:48:53.332ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
37892024-11-15T21:48:53.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37902024-11-15T21:48:53.332ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37912024-11-15T21:48:53.332ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37922024-11-15T21:48:53.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37932024-11-15T21:48:53.334ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8fec5bb7-4a3a-4869-9ac3-e875d38d71a7", "date": "Fri, 15 Nov 2024 21:48:53 GMT"} })
37942024-11-15T21:48:53.336ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 317.498851ms iteration = 15 status = {}
37952024-11-15T21:48:53.342ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37962024-11-15T21:48:53.342ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "644e0387-3cfd-437e-804e-1a1970622216", "content-length": "134", "date": "Fri, 15 Nov 2024 21:48:52 GMT"} })
37972024-11-15T21:48:53.342ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37982024-11-15T21:48:53.342ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
37992024-11-15T21:48:53.342ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38002024-11-15T21:48:53.342ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38012024-11-15T21:48:53.342ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38022024-11-15T21:48:53.343ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38032024-11-15T21:48:53.343ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38042024-11-15T21:48:53.343ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38052024-11-15T21:48:53.343ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38062024-11-15T21:48:53.343ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38072024-11-15T21:48:53.343ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
38082024-11-15T21:48:53.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38092024-11-15T21:48:53.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38102024-11-15T21:48:53.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38112024-11-15T21:48:53.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c81ba42-d09a-45f3-a8eb-426a6b995fb2", "content-length": "2", "date": "Fri, 15 Nov 2024 21:48:52 GMT"} })
38122024-11-15T21:48:53.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38132024-11-15T21:48:53.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "052fd2b3-500a-47eb-81cb-0f87463829c3", "content-length": "52", "date": "Fri, 15 Nov 2024 21:48:52 GMT"} })
38142024-11-15T21:48:53.345ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
38152024-11-15T21:48:53.345ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38162024-11-15T21:48:53.456ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e944a0be-0915-4ddb-8a41-0f560753bf8a", "date": "Fri, 15 Nov 2024 21:48:52 GMT"} })
38172024-11-15T21:48:53.456ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
38182024-11-15T21:48:53.456ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38192024-11-15T21:48:53.456ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8dbfddb-d60c-4355-8f4e-71a411db7a54", "content-length": "682", "date": "Fri, 15 Nov 2024 21:48:53 GMT"} })
38202024-11-15T21:48:53.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38212024-11-15T21:48:53.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38222024-11-15T21:48:53.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38232024-11-15T21:48:53.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38242024-11-15T21:48:53.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38252024-11-15T21:48:53.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38262024-11-15T21:48:53.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38272024-11-15T21:48:53.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38282024-11-15T21:48:53.473ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 454.005396ms iteration = 14 status = {}
38292024-11-15T21:48:53.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b31f7244-039e-4bf4-ba81-4e7bf9c0e6fe roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38302024-11-15T21:48:53.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b31f7244-039e-4bf4-ba81-4e7bf9c0e6fe resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38312024-11-15T21:48:53.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b31f7244-039e-4bf4-ba81-4e7bf9c0e6fe response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38322024-11-15T21:48:53.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 06017e63-8d31-45fc-8992-d3fc7ab7e241 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
38332024-11-15T21:48:53.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 06017e63-8d31-45fc-8992-d3fc7ab7e241 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
38342024-11-15T21:48:53.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 06017e63-8d31-45fc-8992-d3fc7ab7e241 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
38352024-11-15T21:48:54.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fe9c0072-9386-42ff-b7ec-d6d36858a5f0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38362024-11-15T21:48:54.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fe9c0072-9386-42ff-b7ec-d6d36858a5f0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38372024-11-15T21:48:54.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fe9c0072-9386-42ff-b7ec-d6d36858a5f0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38382024-11-15T21:48:55.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 74b76160-381d-4a77-935e-abd2a8cc70a1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38392024-11-15T21:48:55.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 74b76160-381d-4a77-935e-abd2a8cc70a1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38402024-11-15T21:48:55.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 74b76160-381d-4a77-935e-abd2a8cc70a1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38412024-11-15T21:48:56.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = def653b1-fb2c-4498-a73c-55b1e905d128 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38422024-11-15T21:48:56.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = def653b1-fb2c-4498-a73c-55b1e905d128 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38432024-11-15T21:48:56.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = def653b1-fb2c-4498-a73c-55b1e905d128 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38442024-11-15T21:48:57.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 84bab188-2441-4106-82ad-e3086d30f5f3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38452024-11-15T21:48:57.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 84bab188-2441-4106-82ad-e3086d30f5f3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38462024-11-15T21:48:57.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 84bab188-2441-4106-82ad-e3086d30f5f3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38472024-11-15T21:48:58.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d90348f-f3fd-4930-8537-3d93ad09a74c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38482024-11-15T21:48:58.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d90348f-f3fd-4930-8537-3d93ad09a74c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38492024-11-15T21:48:58.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d90348f-f3fd-4930-8537-3d93ad09a74c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38502024-11-15T21:48:59.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3dc20b4-477f-42d9-a095-1adfa72c16c5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38512024-11-15T21:48:59.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3dc20b4-477f-42d9-a095-1adfa72c16c5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38522024-11-15T21:48:59.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3dc20b4-477f-42d9-a095-1adfa72c16c5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38532024-11-15T21:49:00.661ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1206 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 0c2a086d-ad96-4ae2-97d9-2fd6a039e5d3 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
38542024-11-15T21:49:00.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 104e0754-f007-4b62-8e9a-fefb8dc22491 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38552024-11-15T21:49:00.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 104e0754-f007-4b62-8e9a-fefb8dc22491 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38562024-11-15T21:49:00.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 104e0754-f007-4b62-8e9a-fefb8dc22491 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38572024-11-15T21:49:01.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c82d7f72-3f6e-452b-8185-56e07c047a02 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38582024-11-15T21:49:01.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c82d7f72-3f6e-452b-8185-56e07c047a02 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38592024-11-15T21:49:01.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c82d7f72-3f6e-452b-8185-56e07c047a02 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38602024-11-15T21:49:02.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3488518-df7c-455b-9d49-77d0d745d429 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38612024-11-15T21:49:02.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3488518-df7c-455b-9d49-77d0d745d429 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38622024-11-15T21:49:02.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3488518-df7c-455b-9d49-77d0d745d429 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38632024-11-15T21:49:03.018ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
38642024-11-15T21:49:03.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38652024-11-15T21:49:03.018ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
38662024-11-15T21:49:03.018ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38672024-11-15T21:49:03.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38682024-11-15T21:49:03.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38692024-11-15T21:49:03.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38702024-11-15T21:49:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38712024-11-15T21:49:03.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38722024-11-15T21:49:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38732024-11-15T21:49:03.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38742024-11-15T21:49:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38752024-11-15T21:49:03.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38762024-11-15T21:49:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
38772024-11-15T21:49:03.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38782024-11-15T21:49:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38792024-11-15T21:49:03.037ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
38802024-11-15T21:49:03.037ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.069134ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
38812024-11-15T21:49:03.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38822024-11-15T21:49:03.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38832024-11-15T21:49:03.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.654266ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38842024-11-15T21:49:03.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b98fdfe-3285-46df-bd61-6c14a186a451 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38852024-11-15T21:49:03.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b98fdfe-3285-46df-bd61-6c14a186a451 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38862024-11-15T21:49:03.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b98fdfe-3285-46df-bd61-6c14a186a451 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38872024-11-15T21:49:04.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 878b1277-cbfe-4bd4-afb7-b1127c55b4c8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38882024-11-15T21:49:04.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 878b1277-cbfe-4bd4-afb7-b1127c55b4c8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38892024-11-15T21:49:04.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 878b1277-cbfe-4bd4-afb7-b1127c55b4c8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38902024-11-15T21:49:05.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 795e623c-dd67-46a2-8f15-de3c040517a2 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
38912024-11-15T21:49:05.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 795e623c-dd67-46a2-8f15-de3c040517a2 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
38922024-11-15T21:49:05.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 795e623c-dd67-46a2-8f15-de3c040517a2 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
38932024-11-15T21:49:05.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 784df244-6b9d-4dad-ad97-282e93b2121d roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
38942024-11-15T21:49:05.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 784df244-6b9d-4dad-ad97-282e93b2121d resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
38952024-11-15T21:49:05.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 784df244-6b9d-4dad-ad97-282e93b2121d response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
38962024-11-15T21:49:05.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1bfe9246-9fcd-4f23-88c9-a0e1664f01a1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38972024-11-15T21:49:05.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1bfe9246-9fcd-4f23-88c9-a0e1664f01a1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38982024-11-15T21:49:05.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1bfe9246-9fcd-4f23-88c9-a0e1664f01a1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
38992024-11-15T21:49:06.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8c791b75-9427-4383-900c-540352b2e9fa roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39002024-11-15T21:49:06.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8c791b75-9427-4383-900c-540352b2e9fa resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39012024-11-15T21:49:06.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8c791b75-9427-4383-900c-540352b2e9fa response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39022024-11-15T21:49:07.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c6f91d93-69ae-472b-9755-6cd9c0911087 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39032024-11-15T21:49:07.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c6f91d93-69ae-472b-9755-6cd9c0911087 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39042024-11-15T21:49:07.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c6f91d93-69ae-472b-9755-6cd9c0911087 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39052024-11-15T21:49:08.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 740eec36-a67b-4ea5-8e9d-75679c0a513e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39062024-11-15T21:49:08.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 740eec36-a67b-4ea5-8e9d-75679c0a513e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39072024-11-15T21:49:08.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 740eec36-a67b-4ea5-8e9d-75679c0a513e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39082024-11-15T21:49:09.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4f2479af-fd73-4ca0-80b3-9e486339ec1b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39092024-11-15T21:49:09.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4f2479af-fd73-4ca0-80b3-9e486339ec1b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39102024-11-15T21:49:09.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4f2479af-fd73-4ca0-80b3-9e486339ec1b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39112024-11-15T21:49:10.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3498ab0e-8ee2-454b-9c11-e9c724900cfe roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39122024-11-15T21:49:10.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3498ab0e-8ee2-454b-9c11-e9c724900cfe resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39132024-11-15T21:49:10.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3498ab0e-8ee2-454b-9c11-e9c724900cfe response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39142024-11-15T21:49:11.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dd9a90b0-4915-4a38-bb24-e63c7b205f79 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39152024-11-15T21:49:11.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dd9a90b0-4915-4a38-bb24-e63c7b205f79 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39162024-11-15T21:49:11.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dd9a90b0-4915-4a38-bb24-e63c7b205f79 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39172024-11-15T21:49:12.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca4eb78c-04a9-4a7f-b389-9a2a70a1294a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39182024-11-15T21:49:12.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca4eb78c-04a9-4a7f-b389-9a2a70a1294a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39192024-11-15T21:49:12.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca4eb78c-04a9-4a7f-b389-9a2a70a1294a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39202024-11-15T21:49:13.026ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
39212024-11-15T21:49:13.026ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
39222024-11-15T21:49:13.026ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39232024-11-15T21:49:13.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39242024-11-15T21:49:13.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39252024-11-15T21:49:13.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39262024-11-15T21:49:13.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39272024-11-15T21:49:13.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39282024-11-15T21:49:13.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39292024-11-15T21:49:13.030ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.141147ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39302024-11-15T21:49:13.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39312024-11-15T21:49:13.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39322024-11-15T21:49:13.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39332024-11-15T21:49:13.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39342024-11-15T21:49:13.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39352024-11-15T21:49:13.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39362024-11-15T21:49:13.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
39372024-11-15T21:49:13.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39382024-11-15T21:49:13.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39392024-11-15T21:49:13.046ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
39402024-11-15T21:49:13.046ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.453556ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
39412024-11-15T21:49:14.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 66648048-a766-4bf3-87bb-ed0ce133a005 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39422024-11-15T21:49:14.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 66648048-a766-4bf3-87bb-ed0ce133a005 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39432024-11-15T21:49:14.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 66648048-a766-4bf3-87bb-ed0ce133a005 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39442024-11-15T21:49:15.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e36216a2-bbfc-4be1-8eff-1cb3bc3a68c1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39452024-11-15T21:49:15.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e36216a2-bbfc-4be1-8eff-1cb3bc3a68c1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39462024-11-15T21:49:15.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e36216a2-bbfc-4be1-8eff-1cb3bc3a68c1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39472024-11-15T21:49:15.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1414 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 37b91911-59f3-4b05-ac9b-e186fbb56c9d response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
39482024-11-15T21:49:16.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 60317711-8b22-4fb3-8478-ace65b69a249 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39492024-11-15T21:49:16.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 60317711-8b22-4fb3-8478-ace65b69a249 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39502024-11-15T21:49:16.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 60317711-8b22-4fb3-8478-ace65b69a249 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39512024-11-15T21:49:17.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 037bd6b9-771f-4e96-8d50-1679892f4e15 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39522024-11-15T21:49:17.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 037bd6b9-771f-4e96-8d50-1679892f4e15 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39532024-11-15T21:49:17.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 037bd6b9-771f-4e96-8d50-1679892f4e15 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39542024-11-15T21:49:18.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0795ea7f-9900-41a1-85f2-74791a6d7c5c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39552024-11-15T21:49:18.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0795ea7f-9900-41a1-85f2-74791a6d7c5c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39562024-11-15T21:49:18.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0795ea7f-9900-41a1-85f2-74791a6d7c5c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39572024-11-15T21:49:19.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a0ef473f-d5ee-465e-af27-692e1b7ff538 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39582024-11-15T21:49:19.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a0ef473f-d5ee-465e-af27-692e1b7ff538 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39592024-11-15T21:49:19.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a0ef473f-d5ee-465e-af27-692e1b7ff538 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39602024-11-15T21:49:20.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2759010b-afcc-4be7-8175-dd8ba47df655 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39612024-11-15T21:49:20.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2759010b-afcc-4be7-8175-dd8ba47df655 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39622024-11-15T21:49:20.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2759010b-afcc-4be7-8175-dd8ba47df655 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39632024-11-15T21:49:21.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fbc2f098-e746-4793-a558-d249b1569015 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39642024-11-15T21:49:21.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fbc2f098-e746-4793-a558-d249b1569015 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39652024-11-15T21:49:21.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fbc2f098-e746-4793-a558-d249b1569015 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39662024-11-15T21:49:22.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 771d1fb9-b4fd-430e-b779-6a24ddf7f29e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39672024-11-15T21:49:22.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 771d1fb9-b4fd-430e-b779-6a24ddf7f29e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39682024-11-15T21:49:22.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 771d1fb9-b4fd-430e-b779-6a24ddf7f29e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
39692024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
39702024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
39712024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39722024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39732024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
39742024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
39752024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39762024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39772024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
39782024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
39792024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39802024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
39812024-11-15T21:49:23.025ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39822024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
39832024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39842024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
39852024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39862024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39872024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
39882024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
39892024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39902024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
39912024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39922024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
39932024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39942024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
39952024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
39962024-11-15T21:49:23.025ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39972024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39982024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39992024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
40002024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
40012024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
40022024-11-15T21:49:23.025ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40032024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
40042024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40052024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40062024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
40072024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40082024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
40092024-11-15T21:49:23.026ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
40102024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
40112024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.7\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
40122024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40132024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
40142024-11-15T21:49:23.026ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:39:23.025935973 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40152024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
40162024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40172024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40182024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40192024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
40202024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40212024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
40222024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
40232024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40242024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40252024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40262024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
40272024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40282024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
40292024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
40302024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40312024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40322024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40332024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40342024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40352024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40362024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40372024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40382024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40392024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40402024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40412024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40422024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40432024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40442024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40452024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40462024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40472024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
40482024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40492024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40502024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40512024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40522024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40532024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40542024-11-15T21:49:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40552024-11-15T21:49:23.026ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 974098420 } })
40562024-11-15T21:49:23.026ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 974133100 } })
40572024-11-15T21:49:23.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
40582024-11-15T21:49:23.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.53563ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
40592024-11-15T21:49:23.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
40602024-11-15T21:49:23.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.406179ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
40612024-11-15T21:49:23.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40622024-11-15T21:49:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40632024-11-15T21:49:23.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40642024-11-15T21:49:23.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.683971ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40652024-11-15T21:49:23.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40662024-11-15T21:49:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40672024-11-15T21:49:23.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40682024-11-15T21:49:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40692024-11-15T21:49:23.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40702024-11-15T21:49:23.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40712024-11-15T21:49:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40722024-11-15T21:49:23.035ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 982765326 } })
40732024-11-15T21:49:23.035ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40742024-11-15T21:49:23.035ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
40752024-11-15T21:49:23.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40762024-11-15T21:49:23.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40772024-11-15T21:49:23.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40782024-11-15T21:49:23.038ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40792024-11-15T21:49:23.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40802024-11-15T21:49:23.038ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.37658ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
40812024-11-15T21:49:23.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40822024-11-15T21:49:23.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40832024-11-15T21:49:23.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40842024-11-15T21:49:23.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40852024-11-15T21:49:23.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40862024-11-15T21:49:23.041ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40872024-11-15T21:49:23.041ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:39:23.025935973 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40882024-11-15T21:49:23.041ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.903683ms iteration = 8 status = {"expiration":"2024-11-15T21:39:23.025935973Z","pruned":[]}
40892024-11-15T21:49:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40902024-11-15T21:49:23.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40912024-11-15T21:49:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40922024-11-15T21:49:23.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40932024-11-15T21:49:23.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40942024-11-15T21:49:23.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40952024-11-15T21:49:23.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40962024-11-15T21:49:23.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40972024-11-15T21:49:23.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40982024-11-15T21:49:23.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40992024-11-15T21:49:23.047ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 994711774 } })
41002024-11-15T21:49:23.047ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
41012024-11-15T21:49:23.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41022024-11-15T21:49:23.048ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41032024-11-15T21:49:23.048ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41042024-11-15T21:49:23.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41052024-11-15T21:49:23.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41062024-11-15T21:49:23.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41072024-11-15T21:49:23.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41082024-11-15T21:49:23.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41092024-11-15T21:49:23.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41102024-11-15T21:49:23.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41112024-11-15T21:49:23.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41122024-11-15T21:49:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41132024-11-15T21:49:23.056ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41142024-11-15T21:49:23.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41152024-11-15T21:49:23.058ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 5947587 } })
41162024-11-15T21:49:23.058ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
41172024-11-15T21:49:23.064ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41182024-11-15T21:49:23.064ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 38.397709ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41192024-11-15T21:49:23.070ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41202024-11-15T21:49:23.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.601209ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
41212024-11-15T21:49:23.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
41222024-11-15T21:49:23.074ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41232024-11-15T21:49:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41242024-11-15T21:49:23.086ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
41252024-11-15T21:49:23.087ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
41262024-11-15T21:49:23.087ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.232627ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
41272024-11-15T21:49:23.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.041148ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
41282024-11-15T21:49:23.098ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41292024-11-15T21:49:23.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41302024-11-15T21:49:23.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41312024-11-15T21:49:23.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41322024-11-15T21:49:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41332024-11-15T21:49:23.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41342024-11-15T21:49:23.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41352024-11-15T21:49:23.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41362024-11-15T21:49:23.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41372024-11-15T21:49:23.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41382024-11-15T21:49:23.108ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41392024-11-15T21:49:23.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41402024-11-15T21:49:23.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41412024-11-15T21:49:23.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.737573ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41422024-11-15T21:49:23.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41432024-11-15T21:49:23.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
41442024-11-15T21:49:23.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41452024-11-15T21:49:23.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41462024-11-15T21:49:23.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41472024-11-15T21:49:23.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41482024-11-15T21:49:23.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41492024-11-15T21:49:23.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41502024-11-15T21:49:23.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41512024-11-15T21:49:23.115ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41522024-11-15T21:49:23.115ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41532024-11-15T21:49:23.115ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 89.541042ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41542024-11-15T21:49:23.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41552024-11-15T21:49:23.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41562024-11-15T21:49:23.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41572024-11-15T21:49:23.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41582024-11-15T21:49:23.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41592024-11-15T21:49:23.120ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
41602024-11-15T21:49:23.120ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
41612024-11-15T21:49:23.120ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41622024-11-15T21:49:23.120ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41632024-11-15T21:49:23.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41642024-11-15T21:49:23.123ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41652024-11-15T21:49:23.123ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41662024-11-15T21:49:23.123ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41672024-11-15T21:49:23.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41682024-11-15T21:49:23.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
41692024-11-15T21:49:23.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41702024-11-15T21:49:23.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41712024-11-15T21:49:23.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41722024-11-15T21:49:23.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41732024-11-15T21:49:23.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41742024-11-15T21:49:23.129ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
41752024-11-15T21:49:23.129ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 103.161539ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
41762024-11-15T21:49:23.130ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.275213ms iteration = 15 status = 0
41772024-11-15T21:49:23.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41782024-11-15T21:49:23.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41792024-11-15T21:49:23.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41802024-11-15T21:49:23.140ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41812024-11-15T21:49:23.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41822024-11-15T21:49:23.142ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41832024-11-15T21:49:23.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41842024-11-15T21:49:23.146ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41852024-11-15T21:49:23.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41862024-11-15T21:49:23.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 127.098165ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
41872024-11-15T21:49:23.155ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41882024-11-15T21:49:23.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41892024-11-15T21:49:23.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41902024-11-15T21:49:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41912024-11-15T21:49:23.165ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41922024-11-15T21:49:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41932024-11-15T21:49:23.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41942024-11-15T21:49:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41952024-11-15T21:49:23.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 144.430008ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41962024-11-15T21:49:23.176ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
41972024-11-15T21:49:23.176ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
41982024-11-15T21:49:23.176ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
41992024-11-15T21:49:23.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42002024-11-15T21:49:23.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42012024-11-15T21:49:23.178ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42022024-11-15T21:49:23.182ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42032024-11-15T21:49:23.182ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42042024-11-15T21:49:23.182ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.467055ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
42052024-11-15T21:49:23.192ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42062024-11-15T21:49:23.192ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
42072024-11-15T21:49:23.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42082024-11-15T21:49:23.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42092024-11-15T21:49:23.196ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 170.756579ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
42102024-11-15T21:49:23.204ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
42112024-11-15T21:49:23.204ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 178.469908ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42122024-11-15T21:49:23.206ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
42132024-11-15T21:49:23.206ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42142024-11-15T21:49:23.206ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8362671-9223-4d13-bda2-9ba534316b84", "content-length": "26", "date": "Fri, 15 Nov 2024 21:49:22 GMT"} })
42152024-11-15T21:49:23.206ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42162024-11-15T21:49:23.208ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42172024-11-15T21:49:23.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 972d7030-409a-4f7c-a4aa-3f8c2c82ac6e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
42182024-11-15T21:49:23.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 972d7030-409a-4f7c-a4aa-3f8c2c82ac6e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
42192024-11-15T21:49:23.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42202024-11-15T21:49:23.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 972d7030-409a-4f7c-a4aa-3f8c2c82ac6e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
42212024-11-15T21:49:23.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42222024-11-15T21:49:23.213ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42232024-11-15T21:49:23.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42242024-11-15T21:49:23.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42252024-11-15T21:49:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42262024-11-15T21:49:23.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42272024-11-15T21:49:23.228ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
42282024-11-15T21:49:23.228ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 202.325453ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
42292024-11-15T21:49:23.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42302024-11-15T21:49:23.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42312024-11-15T21:49:23.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42322024-11-15T21:49:23.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42332024-11-15T21:49:23.233ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42342024-11-15T21:49:23.233ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42352024-11-15T21:49:23.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42362024-11-15T21:49:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42372024-11-15T21:49:23.234ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
42382024-11-15T21:49:23.234ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42392024-11-15T21:49:23.234ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf9b15e6-2022-4e69-892d-8fae29a6edaa", "content-length": "26", "date": "Fri, 15 Nov 2024 21:49:22 GMT"} })
42402024-11-15T21:49:23.234ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42412024-11-15T21:49:23.236ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
42422024-11-15T21:49:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42432024-11-15T21:49:23.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42442024-11-15T21:49:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42452024-11-15T21:49:23.238ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
42462024-11-15T21:49:23.238ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42472024-11-15T21:49:23.238ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
42482024-11-15T21:49:23.238ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 213.215174ms iteration = 9 status = {"generation":2}
42492024-11-15T21:49:23.242ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
42502024-11-15T21:49:23.242ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
42512024-11-15T21:49:23.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42522024-11-15T21:49:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42532024-11-15T21:49:23.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42542024-11-15T21:49:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42552024-11-15T21:49:23.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42562024-11-15T21:49:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42572024-11-15T21:49:23.248ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
42582024-11-15T21:49:23.248ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
42592024-11-15T21:49:23.248ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
42602024-11-15T21:49:23.248ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 222.815166ms iteration = 9 status = {"generation":1}
42612024-11-15T21:49:23.290ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 264.367056ms iteration = 18 status = {"physical_disks_added":0}
42622024-11-15T21:49:23.300ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42632024-11-15T21:49:23.369ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42642024-11-15T21:49:23.369ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42652024-11-15T21:49:23.371ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "175f0593-e87d-4f38-84e2-c225c7238a84", "content-length": "372", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} })
42662024-11-15T21:49:23.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42672024-11-15T21:49:23.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42682024-11-15T21:49:23.394ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42692024-11-15T21:49:23.395ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f0ff3917-f09a-4ca5-97be-859abe761146", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42702024-11-15T21:49:23.395ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42712024-11-15T21:49:23.396ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "95f6e9eb-6f40-4b44-95c6-6cc2b06c4b80", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42722024-11-15T21:49:23.396ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42732024-11-15T21:49:23.398ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42742024-11-15T21:49:23.398ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 372.471777ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
42752024-11-15T21:49:23.403ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42762024-11-15T21:49:23.403ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "19ded566-cc76-4610-b711-ab07fa308588", "content-length": "691", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} })
42772024-11-15T21:49:23.403ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
42782024-11-15T21:49:23.403ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
42792024-11-15T21:49:23.403ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
42802024-11-15T21:49:23.405ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 380.289189ms iteration = 15 status = {}
42812024-11-15T21:49:23.411ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
42822024-11-15T21:49:23.411ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42832024-11-15T21:49:23.411ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee55ab48-e2db-4b69-ab12-2ca32430ca89", "content-length": "26", "date": "Fri, 15 Nov 2024 21:49:22 GMT"} })
42842024-11-15T21:49:23.411ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42852024-11-15T21:49:23.414ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42862024-11-15T21:49:23.450ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
42872024-11-15T21:49:23.450ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42882024-11-15T21:49:23.453ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0ea916aa-8c70-4b47-84a8-53804e927dd5", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} })
42892024-11-15T21:49:23.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42902024-11-15T21:49:23.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42912024-11-15T21:49:23.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42922024-11-15T21:49:23.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42932024-11-15T21:49:23.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42942024-11-15T21:49:23.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42952024-11-15T21:49:23.462ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42962024-11-15T21:49:23.462ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42972024-11-15T21:49:23.466ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dbc3a4ac-794c-4a56-ae0b-ebebe77a3bb9", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} })
42982024-11-15T21:49:23.468ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 442.796314ms iteration = 16 status = {}
42992024-11-15T21:49:23.533ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43002024-11-15T21:49:23.533ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fea3bf74-db74-4b17-88e9-bf54dc310171", "content-length": "1", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} })
43012024-11-15T21:49:23.534ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43022024-11-15T21:49:23.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43032024-11-15T21:49:23.536ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 510.898916ms iteration = 15 status = null
43042024-11-15T21:49:23.544ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 519.15287ms iteration = 15 status = {}
43052024-11-15T21:49:23.557ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43062024-11-15T21:49:23.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43072024-11-15T21:49:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43082024-11-15T21:49:23.619ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43092024-11-15T21:49:23.619ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "64bd55d3-3980-43b9-afb8-ffd0637cb30b", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43102024-11-15T21:49:23.619ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43112024-11-15T21:49:23.620ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
43122024-11-15T21:49:23.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43132024-11-15T21:49:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43142024-11-15T21:49:23.621ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6d2de0c3-1d25-4f8f-b433-3ddf6ab0a101", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43152024-11-15T21:49:23.621ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43162024-11-15T21:49:23.623ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5a1c378b-848e-43f2-9aef-73ac43cb2f78", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43172024-11-15T21:49:23.623ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43182024-11-15T21:49:23.625ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43192024-11-15T21:49:23.625ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 599.889923ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43202024-11-15T21:49:23.629ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43212024-11-15T21:49:23.630ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7869c531-40cf-4f6a-932b-69da6d038502", "content-length": "134", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} })
43222024-11-15T21:49:23.630ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
43232024-11-15T21:49:23.630ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
43242024-11-15T21:49:23.630ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43252024-11-15T21:49:23.630ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43262024-11-15T21:49:23.630ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43272024-11-15T21:49:23.630ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43282024-11-15T21:49:23.630ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43292024-11-15T21:49:23.630ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43302024-11-15T21:49:23.630ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43312024-11-15T21:49:23.630ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43322024-11-15T21:49:23.631ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
43332024-11-15T21:49:23.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43342024-11-15T21:49:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43352024-11-15T21:49:23.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
43362024-11-15T21:49:23.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ca90415-c93d-47e8-8d8d-85e0a2a67f64", "content-length": "2", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} })
43372024-11-15T21:49:23.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
43382024-11-15T21:49:23.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd9a23f2-f1fa-48a9-87b7-4f66a143073a", "content-length": "52", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} })
43392024-11-15T21:49:23.633ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
43402024-11-15T21:49:23.633ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43412024-11-15T21:49:23.735ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "573aa9b1-d77b-4ed0-9494-66a5e7b5648d", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} })
43422024-11-15T21:49:23.735ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
43432024-11-15T21:49:23.735ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43442024-11-15T21:49:23.735ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a35ce68-5dd6-4fe7-a2fe-23e5a65c79ce", "content-length": "682", "date": "Fri, 15 Nov 2024 21:49:23 GMT"} })
43452024-11-15T21:49:23.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43462024-11-15T21:49:23.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43472024-11-15T21:49:23.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43482024-11-15T21:49:23.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43492024-11-15T21:49:23.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43502024-11-15T21:49:23.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43512024-11-15T21:49:23.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43522024-11-15T21:49:23.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43532024-11-15T21:49:23.752ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 726.447054ms iteration = 15 status = {}
43542024-11-15T21:49:24.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 50b76244-a92b-46ee-8561-a65d25e0880b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
43552024-11-15T21:49:24.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 50b76244-a92b-46ee-8561-a65d25e0880b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
43562024-11-15T21:49:24.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 50b76244-a92b-46ee-8561-a65d25e0880b response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
43572024-11-15T21:49:24.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac233f68-f690-438d-8890-6194b27e2a86 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43582024-11-15T21:49:24.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac233f68-f690-438d-8890-6194b27e2a86 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43592024-11-15T21:49:24.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac233f68-f690-438d-8890-6194b27e2a86 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43602024-11-15T21:49:25.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = faeb5451-aec7-4a95-a937-e256e37edd32 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43612024-11-15T21:49:25.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = faeb5451-aec7-4a95-a937-e256e37edd32 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43622024-11-15T21:49:25.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = faeb5451-aec7-4a95-a937-e256e37edd32 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43632024-11-15T21:49:26.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7c1e3a6f-682f-4efc-89ea-810cc18dff98 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43642024-11-15T21:49:26.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7c1e3a6f-682f-4efc-89ea-810cc18dff98 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43652024-11-15T21:49:26.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7c1e3a6f-682f-4efc-89ea-810cc18dff98 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43662024-11-15T21:49:27.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac17461e-c4b6-4280-a7c8-4e6cd28a69e8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43672024-11-15T21:49:27.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac17461e-c4b6-4280-a7c8-4e6cd28a69e8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43682024-11-15T21:49:27.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac17461e-c4b6-4280-a7c8-4e6cd28a69e8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43692024-11-15T21:49:28.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 840f6d82-3f41-4078-9751-363156ea34ed roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43702024-11-15T21:49:28.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 840f6d82-3f41-4078-9751-363156ea34ed resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43712024-11-15T21:49:28.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 840f6d82-3f41-4078-9751-363156ea34ed response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43722024-11-15T21:49:29.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 196104b4-cd26-4fad-bf29-fccfbbe68841 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43732024-11-15T21:49:29.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 196104b4-cd26-4fad-bf29-fccfbbe68841 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43742024-11-15T21:49:29.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 196104b4-cd26-4fad-bf29-fccfbbe68841 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43752024-11-15T21:49:30.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e95c3606-39e3-40c7-acda-79d2b3b289e5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43762024-11-15T21:49:30.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e95c3606-39e3-40c7-acda-79d2b3b289e5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43772024-11-15T21:49:30.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e95c3606-39e3-40c7-acda-79d2b3b289e5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43782024-11-15T21:49:30.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 74574ca0-6408-4437-9e0e-12f55af0d8ae response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
43792024-11-15T21:49:31.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 11f894b0-245f-4d94-9ca5-a9d94e69f831 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43802024-11-15T21:49:31.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 11f894b0-245f-4d94-9ca5-a9d94e69f831 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43812024-11-15T21:49:31.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 11f894b0-245f-4d94-9ca5-a9d94e69f831 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43822024-11-15T21:49:32.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f5e45c6f-656b-46ff-961f-2b676ea233fe roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43832024-11-15T21:49:32.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f5e45c6f-656b-46ff-961f-2b676ea233fe resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43842024-11-15T21:49:32.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f5e45c6f-656b-46ff-961f-2b676ea233fe response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
43852024-11-15T21:49:33.024ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
43862024-11-15T21:49:33.024ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43872024-11-15T21:49:33.024ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
43882024-11-15T21:49:33.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43892024-11-15T21:49:33.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43902024-11-15T21:49:33.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43912024-11-15T21:49:33.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43922024-11-15T21:49:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43932024-11-15T21:49:33.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43942024-11-15T21:49:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43952024-11-15T21:49:33.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43962024-11-15T21:49:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43972024-11-15T21:49:33.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43982024-11-15T21:49:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
43992024-11-15T21:49:33.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44002024-11-15T21:49:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44012024-11-15T21:49:33.046ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
44022024-11-15T21:49:33.046ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.326415ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
44032024-11-15T21:49:33.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44042024-11-15T21:49:33.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44052024-11-15T21:49:33.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.954242ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44062024-11-15T21:49:33.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9744af58-6625-42a6-8a2f-9cba7bf04bf6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44072024-11-15T21:49:33.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9744af58-6625-42a6-8a2f-9cba7bf04bf6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44082024-11-15T21:49:33.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9744af58-6625-42a6-8a2f-9cba7bf04bf6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44092024-11-15T21:49:34.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ec9f3f30-5a6f-43ff-8321-c4d53376f396 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44102024-11-15T21:49:34.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ec9f3f30-5a6f-43ff-8321-c4d53376f396 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44112024-11-15T21:49:34.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ec9f3f30-5a6f-43ff-8321-c4d53376f396 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44122024-11-15T21:49:35.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d433d4e8-2234-46b3-b2cc-537d0a12bede roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44132024-11-15T21:49:35.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d433d4e8-2234-46b3-b2cc-537d0a12bede resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44142024-11-15T21:49:35.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d433d4e8-2234-46b3-b2cc-537d0a12bede response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44152024-11-15T21:49:36.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8213d110-2351-4cc8-bb25-c554ae27245e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44162024-11-15T21:49:36.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8213d110-2351-4cc8-bb25-c554ae27245e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44172024-11-15T21:49:36.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8213d110-2351-4cc8-bb25-c554ae27245e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44182024-11-15T21:49:37.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f0aea5a3-6d0d-4d20-a81c-c7fcfac3be20 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44192024-11-15T21:49:37.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f0aea5a3-6d0d-4d20-a81c-c7fcfac3be20 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44202024-11-15T21:49:37.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f0aea5a3-6d0d-4d20-a81c-c7fcfac3be20 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44212024-11-15T21:49:38.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1dbb209d-3ec9-4d3f-a960-b97dbe4a61c2 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44222024-11-15T21:49:38.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1dbb209d-3ec9-4d3f-a960-b97dbe4a61c2 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44232024-11-15T21:49:38.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1dbb209d-3ec9-4d3f-a960-b97dbe4a61c2 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44242024-11-15T21:49:39.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 41046452-b42f-47f2-93fc-83643bd0acca roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44252024-11-15T21:49:39.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 41046452-b42f-47f2-93fc-83643bd0acca resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44262024-11-15T21:49:39.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 41046452-b42f-47f2-93fc-83643bd0acca response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44272024-11-15T21:49:40.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9e4fe3e9-68db-4c6e-9258-4d8b70fc12d2 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44282024-11-15T21:49:40.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9e4fe3e9-68db-4c6e-9258-4d8b70fc12d2 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44292024-11-15T21:49:40.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9e4fe3e9-68db-4c6e-9258-4d8b70fc12d2 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44302024-11-15T21:49:41.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 48722a9f-fc54-472a-ab9f-b622a502e9c5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44312024-11-15T21:49:41.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 48722a9f-fc54-472a-ab9f-b622a502e9c5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44322024-11-15T21:49:41.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 48722a9f-fc54-472a-ab9f-b622a502e9c5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44332024-11-15T21:49:42.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fd8a93ff-9349-4fda-86c9-901ccd5cb89a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44342024-11-15T21:49:42.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fd8a93ff-9349-4fda-86c9-901ccd5cb89a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44352024-11-15T21:49:42.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fd8a93ff-9349-4fda-86c9-901ccd5cb89a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44362024-11-15T21:49:43.022ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
44372024-11-15T21:49:43.023ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
44382024-11-15T21:49:43.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44392024-11-15T21:49:43.023ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44402024-11-15T21:49:43.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44412024-11-15T21:49:43.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44422024-11-15T21:49:43.024ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44432024-11-15T21:49:43.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44442024-11-15T21:49:43.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44452024-11-15T21:49:43.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44462024-11-15T21:49:43.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44472024-11-15T21:49:43.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44482024-11-15T21:49:43.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44492024-11-15T21:49:43.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44502024-11-15T21:49:43.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44512024-11-15T21:49:43.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
44522024-11-15T21:49:43.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44532024-11-15T21:49:43.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44542024-11-15T21:49:43.043ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
44552024-11-15T21:49:43.043ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.783935ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
44562024-11-15T21:49:43.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.664322ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44572024-11-15T21:49:43.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bf8123c7-39dd-4d04-8db0-1aad14bec68e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44582024-11-15T21:49:43.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bf8123c7-39dd-4d04-8db0-1aad14bec68e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44592024-11-15T21:49:43.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bf8123c7-39dd-4d04-8db0-1aad14bec68e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44602024-11-15T21:49:44.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14f251d0-04d8-4389-af4f-af5e2f46b817 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44612024-11-15T21:49:44.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14f251d0-04d8-4389-af4f-af5e2f46b817 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44622024-11-15T21:49:44.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14f251d0-04d8-4389-af4f-af5e2f46b817 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44632024-11-15T21:49:45.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1242 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 7d118a7f-8563-450f-8849-5dfe89f6b168 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
44642024-11-15T21:49:45.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 362efc88-338d-48d2-a892-15573c6c155f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44652024-11-15T21:49:45.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 362efc88-338d-48d2-a892-15573c6c155f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44662024-11-15T21:49:45.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 362efc88-338d-48d2-a892-15573c6c155f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44672024-11-15T21:49:46.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31fd23c4-491f-4ebf-a21e-fd469f296109 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44682024-11-15T21:49:46.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31fd23c4-491f-4ebf-a21e-fd469f296109 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44692024-11-15T21:49:46.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31fd23c4-491f-4ebf-a21e-fd469f296109 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44702024-11-15T21:49:47.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 763ab3e4-1e02-4c0b-b573-2deed29503d2 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44712024-11-15T21:49:47.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 763ab3e4-1e02-4c0b-b573-2deed29503d2 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44722024-11-15T21:49:47.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 763ab3e4-1e02-4c0b-b573-2deed29503d2 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44732024-11-15T21:49:48.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = be716ba0-2b95-4c56-b66b-a648f1df96e7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44742024-11-15T21:49:48.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = be716ba0-2b95-4c56-b66b-a648f1df96e7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44752024-11-15T21:49:48.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = be716ba0-2b95-4c56-b66b-a648f1df96e7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44762024-11-15T21:49:49.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b301af3d-21f4-4949-b0e8-812a633f583d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44772024-11-15T21:49:49.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b301af3d-21f4-4949-b0e8-812a633f583d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44782024-11-15T21:49:49.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b301af3d-21f4-4949-b0e8-812a633f583d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44792024-11-15T21:49:50.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8304afee-1539-45a1-87b3-d908a35f1f7c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44802024-11-15T21:49:50.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8304afee-1539-45a1-87b3-d908a35f1f7c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44812024-11-15T21:49:50.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8304afee-1539-45a1-87b3-d908a35f1f7c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44822024-11-15T21:49:51.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 56877291-6ce2-4591-bbd3-dc33b6d7c206 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44832024-11-15T21:49:51.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 56877291-6ce2-4591-bbd3-dc33b6d7c206 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44842024-11-15T21:49:51.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 56877291-6ce2-4591-bbd3-dc33b6d7c206 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44852024-11-15T21:49:52.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca7cd634-4ee0-4464-9c76-930bf124ab64 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44862024-11-15T21:49:52.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca7cd634-4ee0-4464-9c76-930bf124ab64 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44872024-11-15T21:49:52.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca7cd634-4ee0-4464-9c76-930bf124ab64 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
44882024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
44892024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44902024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
44912024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44922024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
44932024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
44942024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44952024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44962024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
44972024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
44982024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
44992024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45002024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45012024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
45022024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45032024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
45042024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
45052024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45062024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45072024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
45082024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45092024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
45102024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45112024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
45122024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
45132024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45142024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45152024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
45162024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45172024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
45182024-11-15T21:49:53.021ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45192024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45202024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
45212024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45222024-11-15T21:49:53.021ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45232024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45242024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45252024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45262024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45272024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45282024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45292024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45302024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45312024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45322024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45332024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45342024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45352024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45362024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45372024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45382024-11-15T21:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45392024-11-15T21:49:53.025ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.005346ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45402024-11-15T21:49:53.026ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 977242018 } })
45412024-11-15T21:49:53.026ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
45422024-11-15T21:49:53.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45432024-11-15T21:49:53.026ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45442024-11-15T21:49:53.026ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45452024-11-15T21:49:53.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45462024-11-15T21:49:53.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 980171057 } })
45472024-11-15T21:49:53.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
45482024-11-15T21:49:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45492024-11-15T21:49:53.030ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45502024-11-15T21:49:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45512024-11-15T21:49:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45522024-11-15T21:49:53.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45532024-11-15T21:49:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45542024-11-15T21:49:53.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45552024-11-15T21:49:53.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45562024-11-15T21:49:53.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45572024-11-15T21:49:53.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45582024-11-15T21:49:53.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45592024-11-15T21:49:53.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45602024-11-15T21:49:53.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45612024-11-15T21:49:53.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45622024-11-15T21:49:53.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45632024-11-15T21:49:53.038ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45642024-11-15T21:49:53.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45652024-11-15T21:49:53.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45662024-11-15T21:49:53.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45672024-11-15T21:49:53.040ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45682024-11-15T21:49:53.041ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45692024-11-15T21:49:53.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45702024-11-15T21:49:53.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45712024-11-15T21:49:53.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45722024-11-15T21:49:53.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45732024-11-15T21:49:53.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45742024-11-15T21:49:53.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45752024-11-15T21:49:53.041ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 993019811 } })
45762024-11-15T21:49:53.042ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
45772024-11-15T21:49:53.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45782024-11-15T21:49:53.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45792024-11-15T21:49:53.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45802024-11-15T21:49:53.047ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45812024-11-15T21:49:53.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45822024-11-15T21:49:53.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45832024-11-15T21:49:53.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45842024-11-15T21:49:53.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45852024-11-15T21:49:53.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45862024-11-15T21:49:53.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45872024-11-15T21:49:53.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
45882024-11-15T21:49:53.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45892024-11-15T21:49:53.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45902024-11-15T21:49:53.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45912024-11-15T21:49:53.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45922024-11-15T21:49:53.065ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45932024-11-15T21:49:53.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45942024-11-15T21:49:53.066ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
45952024-11-15T21:49:53.066ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.198723ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
45962024-11-15T21:49:53.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45972024-11-15T21:49:53.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45982024-11-15T21:49:53.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45992024-11-15T21:49:53.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46002024-11-15T21:49:53.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46012024-11-15T21:49:53.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46022024-11-15T21:49:53.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46032024-11-15T21:49:53.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46042024-11-15T21:49:53.082ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.471552ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
46052024-11-15T21:49:53.083ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46062024-11-15T21:49:53.083ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46072024-11-15T21:49:53.083ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46082024-11-15T21:49:53.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46092024-11-15T21:49:53.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.698117ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
46102024-11-15T21:49:53.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46112024-11-15T21:49:53.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46122024-11-15T21:49:53.089ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46132024-11-15T21:49:53.089ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.470008ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46142024-11-15T21:49:53.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.313344ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46152024-11-15T21:49:53.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.717143ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
46162024-11-15T21:49:53.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46172024-11-15T21:49:53.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46182024-11-15T21:49:53.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.756315ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46192024-11-15T21:49:53.121ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46202024-11-15T21:49:53.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46212024-11-15T21:49:53.163ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 142.090653ms iteration = 19 status = {"physical_disks_added":0}
46222024-11-15T21:49:53.196ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
46232024-11-15T21:49:53.196ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46242024-11-15T21:49:53.197ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b59f78af-8cf6-4926-a608-fa6355d08457", "content-length": "26", "date": "Fri, 15 Nov 2024 21:49:52 GMT"} })
46252024-11-15T21:49:53.197ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46262024-11-15T21:49:53.199ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46272024-11-15T21:49:53.235ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
46282024-11-15T21:49:53.235ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46292024-11-15T21:49:53.236ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c9bf22a-e191-45c8-90e1-bf2565ffe6c9", "content-length": "26", "date": "Fri, 15 Nov 2024 21:49:52 GMT"} })
46302024-11-15T21:49:53.236ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46312024-11-15T21:49:53.238ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46322024-11-15T21:49:53.257ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
46332024-11-15T21:49:53.257ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46342024-11-15T21:49:53.257ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e959c2b0-4381-4144-bdbf-4b20a4d2f8f6", "content-length": "26", "date": "Fri, 15 Nov 2024 21:49:52 GMT"} })
46352024-11-15T21:49:53.257ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46362024-11-15T21:49:53.259ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
46372024-11-15T21:49:53.259ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46382024-11-15T21:49:53.259ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46392024-11-15T21:49:53.260ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9800a55-d3c9-405d-ab1c-d989942a3477", "content-length": "372", "date": "Fri, 15 Nov 2024 21:49:53 GMT"} })
46402024-11-15T21:49:53.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46412024-11-15T21:49:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46422024-11-15T21:49:53.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46432024-11-15T21:49:53.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46442024-11-15T21:49:53.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46452024-11-15T21:49:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
46462024-11-15T21:49:53.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46472024-11-15T21:49:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46482024-11-15T21:49:53.272ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 250.612697ms iteration = 16 status = 0
46492024-11-15T21:49:53.283ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46502024-11-15T21:49:53.283ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46512024-11-15T21:49:53.300ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46522024-11-15T21:49:53.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 279.392503ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
46532024-11-15T21:49:53.302ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46542024-11-15T21:49:53.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46552024-11-15T21:49:53.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46562024-11-15T21:49:53.302ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46572024-11-15T21:49:53.302ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46582024-11-15T21:49:53.302ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 281.219115ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46592024-11-15T21:49:53.308ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 287.160403ms iteration = 16 status = {}
46602024-11-15T21:49:53.324ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46612024-11-15T21:49:53.324ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "eca0333c-f7ed-4962-9261-27e657f9483e", "content-length": "1", "date": "Fri, 15 Nov 2024 21:49:52 GMT"} })
46622024-11-15T21:49:53.326ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46632024-11-15T21:49:53.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46642024-11-15T21:49:53.328ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 306.65816ms iteration = 16 status = null
46652024-11-15T21:49:53.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46662024-11-15T21:49:53.333ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46672024-11-15T21:49:53.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46682024-11-15T21:49:53.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46692024-11-15T21:49:53.387ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f7319e93-4469-47b2-813f-f3ab8945b609", "date": "Fri, 15 Nov 2024 21:49:53 GMT"} })
46702024-11-15T21:49:53.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46712024-11-15T21:49:53.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46722024-11-15T21:49:53.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46732024-11-15T21:49:53.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46742024-11-15T21:49:53.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46752024-11-15T21:49:53.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46762024-11-15T21:49:53.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46772024-11-15T21:49:53.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46782024-11-15T21:49:53.395ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
46792024-11-15T21:49:53.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46802024-11-15T21:49:53.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46812024-11-15T21:49:53.423ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46822024-11-15T21:49:53.424ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4df9387c-7c71-41e1-826d-d83a8b873e5f", "content-length": "691", "date": "Fri, 15 Nov 2024 21:49:53 GMT"} })
46832024-11-15T21:49:53.424ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46842024-11-15T21:49:53.424ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46852024-11-15T21:49:53.424ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46862024-11-15T21:49:53.424ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 403.53102ms iteration = 16 status = {}
46872024-11-15T21:49:53.426ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46882024-11-15T21:49:53.426ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46892024-11-15T21:49:53.427ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "152f3f84-8aec-475f-92a1-bbf450ad0181", "date": "Fri, 15 Nov 2024 21:49:53 GMT"} })
46902024-11-15T21:49:53.428ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 406.988652ms iteration = 17 status = {}
46912024-11-15T21:49:53.435ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46922024-11-15T21:49:53.435ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6a70ca0-aa64-4686-98e5-11489167803a", "content-length": "134", "date": "Fri, 15 Nov 2024 21:49:52 GMT"} })
46932024-11-15T21:49:53.435ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46942024-11-15T21:49:53.435ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
46952024-11-15T21:49:53.435ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46962024-11-15T21:49:53.435ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46972024-11-15T21:49:53.435ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46982024-11-15T21:49:53.435ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46992024-11-15T21:49:53.435ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47002024-11-15T21:49:53.435ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47012024-11-15T21:49:53.436ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47022024-11-15T21:49:53.436ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47032024-11-15T21:49:53.436ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
47042024-11-15T21:49:53.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47052024-11-15T21:49:53.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47062024-11-15T21:49:53.438ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47072024-11-15T21:49:53.438ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac4a0649-b8c4-443c-afcb-db2cfc28ad50", "content-length": "2", "date": "Fri, 15 Nov 2024 21:49:52 GMT"} })
47082024-11-15T21:49:53.438ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47092024-11-15T21:49:53.438ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "468518a7-4ead-42ff-87e6-914e2425b57c", "content-length": "52", "date": "Fri, 15 Nov 2024 21:49:52 GMT"} })
47102024-11-15T21:49:53.438ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
47112024-11-15T21:49:53.438ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47122024-11-15T21:49:53.537ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "56057015-256e-46f7-b9e5-8a24d951ff93", "date": "Fri, 15 Nov 2024 21:49:53 GMT"} })
47132024-11-15T21:49:53.537ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
47142024-11-15T21:49:53.537ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47152024-11-15T21:49:53.537ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3f1f05b-26c7-4e7d-8e00-f667e7ab875a", "content-length": "682", "date": "Fri, 15 Nov 2024 21:49:53 GMT"} })
47162024-11-15T21:49:53.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47172024-11-15T21:49:53.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47182024-11-15T21:49:53.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47192024-11-15T21:49:53.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47202024-11-15T21:49:53.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47212024-11-15T21:49:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47222024-11-15T21:49:53.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47232024-11-15T21:49:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47242024-11-15T21:49:53.555ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 534.077786ms iteration = 16 status = {}
47252024-11-15T21:49:53.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ed5dc787-423c-4bbf-98cb-c1c910bf2c40 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47262024-11-15T21:49:53.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ed5dc787-423c-4bbf-98cb-c1c910bf2c40 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47272024-11-15T21:49:53.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ed5dc787-423c-4bbf-98cb-c1c910bf2c40 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47282024-11-15T21:49:54.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 095d65a7-9451-484b-ad2e-0d6d34ea3005 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
47292024-11-15T21:49:54.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 095d65a7-9451-484b-ad2e-0d6d34ea3005 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
47302024-11-15T21:49:54.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 095d65a7-9451-484b-ad2e-0d6d34ea3005 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
47312024-11-15T21:49:54.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3582acc-abf7-4567-b6a2-9cf1df58e6f9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47322024-11-15T21:49:54.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3582acc-abf7-4567-b6a2-9cf1df58e6f9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47332024-11-15T21:49:54.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3582acc-abf7-4567-b6a2-9cf1df58e6f9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47342024-11-15T21:49:55.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 209162ac-526b-4498-ba91-cd838872768e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47352024-11-15T21:49:55.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 209162ac-526b-4498-ba91-cd838872768e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47362024-11-15T21:49:55.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 209162ac-526b-4498-ba91-cd838872768e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47372024-11-15T21:49:56.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 70e972ac-2202-4289-943a-95f2df8624f6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47382024-11-15T21:49:56.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 70e972ac-2202-4289-943a-95f2df8624f6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47392024-11-15T21:49:56.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 70e972ac-2202-4289-943a-95f2df8624f6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47402024-11-15T21:49:57.040ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
47412024-11-15T21:49:57.040ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
47422024-11-15T21:49:57.070ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
47432024-11-15T21:49:57.070ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:53773
47442024-11-15T21:49:57.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53773 req_id = b920cb8c-a480-447e-95fa-f7332744b68b roles = RoleSet { roles: {} } uri = /metrics/producers
47452024-11-15T21:49:57.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53773 req_id = b920cb8c-a480-447e-95fa-f7332744b68b resource = Database result = Ok(()) uri = /metrics/producers
47462024-11-15T21:49:57.111ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
47472024-11-15T21:49:57.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40155 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53773 req_id = b920cb8c-a480-447e-95fa-f7332744b68b response_code = 201 uri = /metrics/producers
47482024-11-15T21:49:57.111ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b920cb8c-a480-447e-95fa-f7332744b68b", "content-length": "41", "date": "Fri, 15 Nov 2024 21:49:56 GMT"} })
47492024-11-15T21:49:57.112ZDEBGnexus (producer-registration-task): registered with nexus successfully
47502024-11-15T21:49:57.112ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
47512024-11-15T21:49:57.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e711fd40-449a-4010-a3f0-d9b3991b41c9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47522024-11-15T21:49:57.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e711fd40-449a-4010-a3f0-d9b3991b41c9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47532024-11-15T21:49:57.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e711fd40-449a-4010-a3f0-d9b3991b41c9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47542024-11-15T21:49:59.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 07437f0a-2c30-4eb1-919b-8d814650ebcd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47552024-11-15T21:49:59.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 07437f0a-2c30-4eb1-919b-8d814650ebcd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47562024-11-15T21:49:59.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 07437f0a-2c30-4eb1-919b-8d814650ebcd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47572024-11-15T21:50:00.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d34bfa41-1637-456c-aa66-0edb1e3d37c3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47582024-11-15T21:50:00.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d34bfa41-1637-456c-aa66-0edb1e3d37c3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47592024-11-15T21:50:00.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d34bfa41-1637-456c-aa66-0edb1e3d37c3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47602024-11-15T21:50:00.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1582 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 784664a0-ae19-42b8-9f1d-937b6c86c366 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
47612024-11-15T21:50:01.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 45894672-4509-42e1-8f05-b20c945dd8f2 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47622024-11-15T21:50:01.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 45894672-4509-42e1-8f05-b20c945dd8f2 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47632024-11-15T21:50:01.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 45894672-4509-42e1-8f05-b20c945dd8f2 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47642024-11-15T21:50:02.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d3b2d420-4030-4796-af34-aba46a7da953 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47652024-11-15T21:50:02.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d3b2d420-4030-4796-af34-aba46a7da953 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47662024-11-15T21:50:02.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d3b2d420-4030-4796-af34-aba46a7da953 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47672024-11-15T21:50:03.021ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
47682024-11-15T21:50:03.021ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
47692024-11-15T21:50:03.021ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47702024-11-15T21:50:03.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47712024-11-15T21:50:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47722024-11-15T21:50:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47732024-11-15T21:50:03.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47742024-11-15T21:50:03.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47752024-11-15T21:50:03.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.680802ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47762024-11-15T21:50:03.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47772024-11-15T21:50:03.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47782024-11-15T21:50:03.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47792024-11-15T21:50:03.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47802024-11-15T21:50:03.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47812024-11-15T21:50:03.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47822024-11-15T21:50:03.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47832024-11-15T21:50:03.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
47842024-11-15T21:50:03.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47852024-11-15T21:50:03.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47862024-11-15T21:50:03.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
47872024-11-15T21:50:03.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.849163ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
47882024-11-15T21:50:03.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 482ff652-3360-42a9-8caa-7aed6f105c71 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47892024-11-15T21:50:03.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 482ff652-3360-42a9-8caa-7aed6f105c71 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47902024-11-15T21:50:03.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 482ff652-3360-42a9-8caa-7aed6f105c71 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47912024-11-15T21:50:04.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 410e97d0-5f4f-48ca-88b3-c6fb5d7d736f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47922024-11-15T21:50:04.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 410e97d0-5f4f-48ca-88b3-c6fb5d7d736f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47932024-11-15T21:50:04.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 410e97d0-5f4f-48ca-88b3-c6fb5d7d736f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47942024-11-15T21:50:05.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eb6acac0-d27e-41f4-969d-f8d17ad322bd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47952024-11-15T21:50:05.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eb6acac0-d27e-41f4-969d-f8d17ad322bd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47962024-11-15T21:50:05.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eb6acac0-d27e-41f4-969d-f8d17ad322bd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47972024-11-15T21:50:06.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8ba26abe-4dc9-4258-8908-f1ad08c24bdf roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47982024-11-15T21:50:06.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8ba26abe-4dc9-4258-8908-f1ad08c24bdf resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
47992024-11-15T21:50:06.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8ba26abe-4dc9-4258-8908-f1ad08c24bdf response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48002024-11-15T21:50:07.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7d21df1a-15ca-437e-9256-bd71fc69f7d6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48012024-11-15T21:50:07.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7d21df1a-15ca-437e-9256-bd71fc69f7d6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48022024-11-15T21:50:07.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7d21df1a-15ca-437e-9256-bd71fc69f7d6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48032024-11-15T21:50:08.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7a2aa203-c00b-40e3-8dd4-8801e6f09286 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48042024-11-15T21:50:08.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7a2aa203-c00b-40e3-8dd4-8801e6f09286 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48052024-11-15T21:50:08.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7a2aa203-c00b-40e3-8dd4-8801e6f09286 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48062024-11-15T21:50:08.816ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:62253
48072024-11-15T21:50:08.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62253 req_id = 6a1b920b-4a97-4d28-916d-ea3689237d2c roles = RoleSet { roles: {} } uri = /metrics/producers
48082024-11-15T21:50:08.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62253 req_id = 6a1b920b-4a97-4d28-916d-ea3689237d2c resource = Database result = Ok(()) uri = /metrics/producers
48092024-11-15T21:50:08.859ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 5e8fa613-d1c4-416c-8557-742a109ff40b
48102024-11-15T21:50:08.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42319 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62253 req_id = 6a1b920b-4a97-4d28-916d-ea3689237d2c response_code = 201 uri = /metrics/producers
48112024-11-15T21:50:09.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d2169754-02f0-4a48-857f-99c91e5640c9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48122024-11-15T21:50:09.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d2169754-02f0-4a48-857f-99c91e5640c9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48132024-11-15T21:50:09.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d2169754-02f0-4a48-857f-99c91e5640c9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48142024-11-15T21:50:10.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 32a229b4-3c8a-44c3-91c5-5df29bff6486 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48152024-11-15T21:50:10.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 32a229b4-3c8a-44c3-91c5-5df29bff6486 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48162024-11-15T21:50:10.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 32a229b4-3c8a-44c3-91c5-5df29bff6486 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48172024-11-15T21:50:11.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ffdde737-16ae-4260-800a-26be2037ca68 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48182024-11-15T21:50:11.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ffdde737-16ae-4260-800a-26be2037ca68 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48192024-11-15T21:50:11.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ffdde737-16ae-4260-800a-26be2037ca68 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48202024-11-15T21:50:12.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8678db67-d770-4454-a0e8-8441558d5d81 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48212024-11-15T21:50:12.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8678db67-d770-4454-a0e8-8441558d5d81 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48222024-11-15T21:50:12.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8678db67-d770-4454-a0e8-8441558d5d81 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48232024-11-15T21:50:13.023ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
48242024-11-15T21:50:13.023ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
48252024-11-15T21:50:13.023ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48262024-11-15T21:50:13.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48272024-11-15T21:50:13.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48282024-11-15T21:50:13.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48292024-11-15T21:50:13.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48302024-11-15T21:50:13.057ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48312024-11-15T21:50:13.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48322024-11-15T21:50:13.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48332024-11-15T21:50:13.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48342024-11-15T21:50:13.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48352024-11-15T21:50:13.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48362024-11-15T21:50:13.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48372024-11-15T21:50:13.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48382024-11-15T21:50:13.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
48392024-11-15T21:50:13.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48402024-11-15T21:50:13.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48412024-11-15T21:50:13.076ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
48422024-11-15T21:50:13.076ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.041055ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
48432024-11-15T21:50:13.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.20387ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48442024-11-15T21:50:13.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 079123c2-1e7c-415e-af67-89aac527c624 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48452024-11-15T21:50:13.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 079123c2-1e7c-415e-af67-89aac527c624 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48462024-11-15T21:50:13.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 079123c2-1e7c-415e-af67-89aac527c624 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48472024-11-15T21:50:14.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 56dcc8f9-dc3b-492f-9746-1e9b5ab28daf roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48482024-11-15T21:50:14.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 56dcc8f9-dc3b-492f-9746-1e9b5ab28daf resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48492024-11-15T21:50:14.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 56dcc8f9-dc3b-492f-9746-1e9b5ab28daf response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48502024-11-15T21:50:15.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6a88b9e-cb52-4f63-8954-a790277014f8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48512024-11-15T21:50:15.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6a88b9e-cb52-4f63-8954-a790277014f8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48522024-11-15T21:50:15.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6a88b9e-cb52-4f63-8954-a790277014f8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48532024-11-15T21:50:15.669ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1472 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 4a4b955c-ecac-4b3c-a287-f3bb7d5c83e3 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
48542024-11-15T21:50:16.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 88a30d08-1a4c-445d-8788-ca5632c3dca4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48552024-11-15T21:50:16.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 88a30d08-1a4c-445d-8788-ca5632c3dca4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48562024-11-15T21:50:16.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 88a30d08-1a4c-445d-8788-ca5632c3dca4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48572024-11-15T21:50:16.899ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:40499
48582024-11-15T21:50:16.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40499 req_id = a43cc4a9-9655-477b-98af-8ee585c1a225 roles = RoleSet { roles: {} } uri = /metrics/producers
48592024-11-15T21:50:16.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40499 req_id = a43cc4a9-9655-477b-98af-8ee585c1a225 resource = Database result = Ok(()) uri = /metrics/producers
48602024-11-15T21:50:16.908ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 78d47478-5af8-488d-89c5-11be23443b63
48612024-11-15T21:50:16.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9205 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40499 req_id = a43cc4a9-9655-477b-98af-8ee585c1a225 response_code = 201 uri = /metrics/producers
48622024-11-15T21:50:17.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0d6218b7-214a-4933-b698-e759454c75f3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48632024-11-15T21:50:17.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0d6218b7-214a-4933-b698-e759454c75f3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48642024-11-15T21:50:17.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0d6218b7-214a-4933-b698-e759454c75f3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48652024-11-15T21:50:18.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8d30ebd7-1bfa-4681-b879-e27adfe696dc roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48662024-11-15T21:50:18.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8d30ebd7-1bfa-4681-b879-e27adfe696dc resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48672024-11-15T21:50:18.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8d30ebd7-1bfa-4681-b879-e27adfe696dc response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48682024-11-15T21:50:19.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9fa5f5cd-8db9-4691-81da-005e151ac2b7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48692024-11-15T21:50:19.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9fa5f5cd-8db9-4691-81da-005e151ac2b7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48702024-11-15T21:50:19.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9fa5f5cd-8db9-4691-81da-005e151ac2b7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48712024-11-15T21:50:20.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 895647f3-9132-40ed-b17a-632301d529f0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48722024-11-15T21:50:20.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 895647f3-9132-40ed-b17a-632301d529f0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48732024-11-15T21:50:20.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 895647f3-9132-40ed-b17a-632301d529f0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48742024-11-15T21:50:21.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 236cdfdf-f4eb-45a2-a2fb-ce7bc00d91b9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48752024-11-15T21:50:21.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 236cdfdf-f4eb-45a2-a2fb-ce7bc00d91b9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48762024-11-15T21:50:21.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 236cdfdf-f4eb-45a2-a2fb-ce7bc00d91b9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48772024-11-15T21:50:22.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1574697-ad56-425a-9d36-0160c619cdeb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48782024-11-15T21:50:22.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1574697-ad56-425a-9d36-0160c619cdeb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48792024-11-15T21:50:22.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1574697-ad56-425a-9d36-0160c619cdeb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
48802024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
48812024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48822024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
48832024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
48842024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48852024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48862024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
48872024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
48882024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48892024-11-15T21:50:23.031ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
48902024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
48912024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.91\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
48922024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48932024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
48942024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
48952024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48962024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
48972024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48982024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
48992024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
49002024-11-15T21:50:23.031ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
49012024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49022024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
49032024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
49042024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49052024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
49062024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49072024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49082024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
49092024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
49102024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49112024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
49122024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49132024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
49142024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
49152024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
49162024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
49172024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49182024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
49192024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
49202024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49212024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49222024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
49232024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49242024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
49252024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
49262024-11-15T21:50:23.031ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:40:23.031417544 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
49272024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
49282024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
49292024-11-15T21:50:23.031ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49302024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49312024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
49322024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
49332024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
49342024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
49352024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49362024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
49372024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49382024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
49392024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49402024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
49412024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49422024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49432024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49442024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49452024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49462024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49472024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49482024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49492024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49502024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49512024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49522024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49532024-11-15T21:50:23.031ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 974427669 } })
49542024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49552024-11-15T21:50:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49562024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49572024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49582024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49592024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49602024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49612024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49622024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49632024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49642024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49652024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49662024-11-15T21:50:23.032ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 974568440 } })
49672024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49682024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
49692024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.274349ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
49702024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
49712024-11-15T21:50:23.032ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.4516ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
49722024-11-15T21:50:23.035ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 977463739 } })
49732024-11-15T21:50:23.035ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
49742024-11-15T21:50:23.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49752024-11-15T21:50:23.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49762024-11-15T21:50:23.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49772024-11-15T21:50:23.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49782024-11-15T21:50:23.036ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.59191ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49792024-11-15T21:50:23.036ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 979103630 } })
49802024-11-15T21:50:23.036ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
49812024-11-15T21:50:23.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49822024-11-15T21:50:23.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49832024-11-15T21:50:23.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49842024-11-15T21:50:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49852024-11-15T21:50:23.039ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49862024-11-15T21:50:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49872024-11-15T21:50:23.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49882024-11-15T21:50:23.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49892024-11-15T21:50:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49902024-11-15T21:50:23.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49912024-11-15T21:50:23.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49922024-11-15T21:50:23.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49932024-11-15T21:50:23.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49942024-11-15T21:50:23.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49952024-11-15T21:50:23.050ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:40:23.031417544 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49962024-11-15T21:50:23.050ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.924513ms iteration = 9 status = {"expiration":"2024-11-15T21:40:23.031417544Z","pruned":[]}
49972024-11-15T21:50:23.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49982024-11-15T21:50:23.051ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.112951ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
49992024-11-15T21:50:23.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50002024-11-15T21:50:23.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50012024-11-15T21:50:23.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50022024-11-15T21:50:23.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50032024-11-15T21:50:23.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50042024-11-15T21:50:23.056ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50052024-11-15T21:50:23.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50062024-11-15T21:50:23.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.83045ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50072024-11-15T21:50:23.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50082024-11-15T21:50:23.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50092024-11-15T21:50:23.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50102024-11-15T21:50:23.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50112024-11-15T21:50:23.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50122024-11-15T21:50:23.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50132024-11-15T21:50:23.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50142024-11-15T21:50:23.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50152024-11-15T21:50:23.091ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50162024-11-15T21:50:23.092ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50172024-11-15T21:50:23.092ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50182024-11-15T21:50:23.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50192024-11-15T21:50:23.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50202024-11-15T21:50:23.093ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50212024-11-15T21:50:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50222024-11-15T21:50:23.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.009398ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
50232024-11-15T21:50:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
50242024-11-15T21:50:23.094ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50252024-11-15T21:50:23.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50262024-11-15T21:50:23.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50272024-11-15T21:50:23.095ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.512489ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
50282024-11-15T21:50:23.097ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50292024-11-15T21:50:23.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50302024-11-15T21:50:23.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50312024-11-15T21:50:23.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50322024-11-15T21:50:23.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50332024-11-15T21:50:23.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50342024-11-15T21:50:23.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50352024-11-15T21:50:23.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50362024-11-15T21:50:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50372024-11-15T21:50:23.102ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50382024-11-15T21:50:23.102ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50392024-11-15T21:50:23.102ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.227983ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50402024-11-15T21:50:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
50412024-11-15T21:50:23.102ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50422024-11-15T21:50:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50432024-11-15T21:50:23.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50442024-11-15T21:50:23.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50452024-11-15T21:50:23.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50462024-11-15T21:50:23.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
50472024-11-15T21:50:23.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50482024-11-15T21:50:23.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50492024-11-15T21:50:23.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50502024-11-15T21:50:23.108ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50512024-11-15T21:50:23.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50522024-11-15T21:50:23.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50532024-11-15T21:50:23.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50542024-11-15T21:50:23.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50552024-11-15T21:50:23.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50562024-11-15T21:50:23.114ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 56638163 } })
50572024-11-15T21:50:23.114ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
50582024-11-15T21:50:23.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50592024-11-15T21:50:23.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50602024-11-15T21:50:23.117ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50612024-11-15T21:50:23.117ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.967247ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50622024-11-15T21:50:23.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50632024-11-15T21:50:23.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
50642024-11-15T21:50:23.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50652024-11-15T21:50:23.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50662024-11-15T21:50:23.125ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 94.06122ms iteration = 17 status = 0
50672024-11-15T21:50:23.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
50682024-11-15T21:50:23.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.07547ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
50692024-11-15T21:50:23.130ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.708827ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50702024-11-15T21:50:23.131ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50712024-11-15T21:50:23.131ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50722024-11-15T21:50:23.131ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50732024-11-15T21:50:23.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50742024-11-15T21:50:23.133ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
50752024-11-15T21:50:23.133ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
50762024-11-15T21:50:23.133ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.693886ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
50772024-11-15T21:50:23.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50782024-11-15T21:50:23.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50792024-11-15T21:50:23.140ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50802024-11-15T21:50:23.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50812024-11-15T21:50:23.151ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50822024-11-15T21:50:23.151ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50832024-11-15T21:50:23.152ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50842024-11-15T21:50:23.152ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50852024-11-15T21:50:23.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50862024-11-15T21:50:23.152ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50872024-11-15T21:50:23.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50882024-11-15T21:50:23.157ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50892024-11-15T21:50:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50902024-11-15T21:50:23.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50912024-11-15T21:50:23.159ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50922024-11-15T21:50:23.159ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50932024-11-15T21:50:23.159ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50942024-11-15T21:50:23.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50952024-11-15T21:50:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50962024-11-15T21:50:23.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50972024-11-15T21:50:23.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 130.360526ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50982024-11-15T21:50:23.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50992024-11-15T21:50:23.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51002024-11-15T21:50:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51012024-11-15T21:50:23.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51022024-11-15T21:50:23.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51032024-11-15T21:50:23.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51042024-11-15T21:50:23.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51052024-11-15T21:50:23.166ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51062024-11-15T21:50:23.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51072024-11-15T21:50:23.168ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
51082024-11-15T21:50:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51092024-11-15T21:50:23.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51102024-11-15T21:50:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51112024-11-15T21:50:23.171ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51122024-11-15T21:50:23.173ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51132024-11-15T21:50:23.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51142024-11-15T21:50:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51152024-11-15T21:50:23.181ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51162024-11-15T21:50:23.181ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51172024-11-15T21:50:23.181ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.994443ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51182024-11-15T21:50:23.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51192024-11-15T21:50:23.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51202024-11-15T21:50:23.190ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.125833ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51212024-11-15T21:50:23.200ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51222024-11-15T21:50:23.200ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
51232024-11-15T21:50:23.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51242024-11-15T21:50:23.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51252024-11-15T21:50:23.207ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
51262024-11-15T21:50:23.207ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
51272024-11-15T21:50:23.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51282024-11-15T21:50:23.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51292024-11-15T21:50:23.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51302024-11-15T21:50:23.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51312024-11-15T21:50:23.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51322024-11-15T21:50:23.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51332024-11-15T21:50:23.218ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
51342024-11-15T21:50:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 187.673508ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51352024-11-15T21:50:23.222ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
51362024-11-15T21:50:23.222ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51372024-11-15T21:50:23.222ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
51382024-11-15T21:50:23.222ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 190.795638ms iteration = 10 status = {"generation":1}
51392024-11-15T21:50:23.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51402024-11-15T21:50:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51412024-11-15T21:50:23.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51422024-11-15T21:50:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51432024-11-15T21:50:23.240ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
51442024-11-15T21:50:23.240ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51452024-11-15T21:50:23.240ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
51462024-11-15T21:50:23.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 209.44308ms iteration = 10 status = {"generation":2}
51472024-11-15T21:50:23.251ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
51482024-11-15T21:50:23.251ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 219.822746ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
51492024-11-15T21:50:23.252ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.997325ms iteration = 20 status = {"physical_disks_added":0}
51502024-11-15T21:50:23.270ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
51512024-11-15T21:50:23.270ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51522024-11-15T21:50:23.270ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78d61753-5ba5-4a03-abbf-0636c9a0580c", "content-length": "26", "date": "Fri, 15 Nov 2024 21:50:22 GMT"} })
51532024-11-15T21:50:23.270ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51542024-11-15T21:50:23.272ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51552024-11-15T21:50:23.300ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51562024-11-15T21:50:23.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51572024-11-15T21:50:23.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51582024-11-15T21:50:23.304ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51592024-11-15T21:50:23.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51602024-11-15T21:50:23.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51612024-11-15T21:50:23.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51622024-11-15T21:50:23.306ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
51632024-11-15T21:50:23.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51642024-11-15T21:50:23.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51652024-11-15T21:50:23.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51662024-11-15T21:50:23.326ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
51672024-11-15T21:50:23.326ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51682024-11-15T21:50:23.327ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "578add89-fcfd-4728-b949-32ad3b1f4ef8", "content-length": "26", "date": "Fri, 15 Nov 2024 21:50:22 GMT"} })
51692024-11-15T21:50:23.327ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51702024-11-15T21:50:23.328ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51712024-11-15T21:50:23.346ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
51722024-11-15T21:50:23.346ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "88261cf6-47a1-41ca-a63d-3271f948315d", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51732024-11-15T21:50:23.346ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51742024-11-15T21:50:23.348ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9caa65d4-7a9b-499e-9c7d-863c97753a3e", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51752024-11-15T21:50:23.348ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51762024-11-15T21:50:23.349ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51772024-11-15T21:50:23.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 318.732969ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
51782024-11-15T21:50:23.374ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
51792024-11-15T21:50:23.374ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51802024-11-15T21:50:23.374ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d48a848-855f-45e8-8d73-8eb6eaefd03a", "content-length": "26", "date": "Fri, 15 Nov 2024 21:50:22 GMT"} })
51812024-11-15T21:50:23.374ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51822024-11-15T21:50:23.376ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
51832024-11-15T21:50:23.404ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 372.975851ms iteration = 17 status = {}
51842024-11-15T21:50:23.409ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51852024-11-15T21:50:23.409ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51862024-11-15T21:50:23.409ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4090499-0288-4eba-be80-232f54970fee", "content-length": "372", "date": "Fri, 15 Nov 2024 21:50:22 GMT"} })
51872024-11-15T21:50:23.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51882024-11-15T21:50:23.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51892024-11-15T21:50:23.458ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
51902024-11-15T21:50:23.465ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51912024-11-15T21:50:23.465ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51922024-11-15T21:50:23.465ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "009c4112-c5e3-4347-8435-17eb60aa6700", "date": "Fri, 15 Nov 2024 21:50:22 GMT"} })
51932024-11-15T21:50:23.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51942024-11-15T21:50:23.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51952024-11-15T21:50:23.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51962024-11-15T21:50:23.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51972024-11-15T21:50:23.574ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
51982024-11-15T21:50:23.575ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "70f79124-00aa-42d2-b059-290ecc02d647", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51992024-11-15T21:50:23.575ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52002024-11-15T21:50:23.576ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3a089085-17e6-4120-acb3-190ec5af6f3e", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52012024-11-15T21:50:23.576ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52022024-11-15T21:50:23.577ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c222ecf6-bd1e-4967-bb61-386175b619dd", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52032024-11-15T21:50:23.577ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52042024-11-15T21:50:23.579ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52052024-11-15T21:50:23.579ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 548.274278ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
52062024-11-15T21:50:23.591ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52072024-11-15T21:50:23.593ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52082024-11-15T21:50:23.594ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f5f5443-d0ab-475b-9dda-1c263126fa35", "content-length": "1", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} })
52092024-11-15T21:50:23.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52102024-11-15T21:50:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52112024-11-15T21:50:23.595ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52122024-11-15T21:50:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52132024-11-15T21:50:23.597ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 566.611456ms iteration = 17 status = null
52142024-11-15T21:50:23.598ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52152024-11-15T21:50:23.598ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52162024-11-15T21:50:23.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52172024-11-15T21:50:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52182024-11-15T21:50:23.626ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
52192024-11-15T21:50:23.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52202024-11-15T21:50:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52212024-11-15T21:50:23.637ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52222024-11-15T21:50:23.638ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "72685df0-03ad-41c7-b6fb-0781a5636dcb", "content-length": "134", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} })
52232024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52242024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
52252024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52262024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52272024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52282024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52292024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52302024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52312024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52322024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52332024-11-15T21:50:23.638ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
52342024-11-15T21:50:23.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52352024-11-15T21:50:23.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52362024-11-15T21:50:23.641ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52372024-11-15T21:50:23.641ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "64c19e60-068b-4597-b647-822640de6ba3", "content-length": "2", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} })
52382024-11-15T21:50:23.641ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52392024-11-15T21:50:23.641ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "624409a9-899a-4710-b24f-616b9e95e345", "content-length": "52", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} })
52402024-11-15T21:50:23.641ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
52412024-11-15T21:50:23.641ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52422024-11-15T21:50:23.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 03070b65-3e36-4f56-82db-f10380726a2c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52432024-11-15T21:50:23.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 03070b65-3e36-4f56-82db-f10380726a2c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52442024-11-15T21:50:23.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 03070b65-3e36-4f56-82db-f10380726a2c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52452024-11-15T21:50:23.665ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c114ae2-dae9-455f-adab-a5b48825ebc3", "content-length": "691", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} })
52462024-11-15T21:50:23.665ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
52472024-11-15T21:50:23.665ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
52482024-11-15T21:50:23.665ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
52492024-11-15T21:50:23.665ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a20e07ca-9434-4de9-b2f6-d20c5fe85fe2", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} })
52502024-11-15T21:50:23.666ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 635.368923ms iteration = 18 status = {}
52512024-11-15T21:50:23.667ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 636.42019ms iteration = 17 status = {}
52522024-11-15T21:50:23.751ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6dd1440b-675e-4d67-8dee-9a12d558f570", "date": "Fri, 15 Nov 2024 21:50:22 GMT"} })
52532024-11-15T21:50:23.751ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
52542024-11-15T21:50:23.751ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52552024-11-15T21:50:23.751ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "069b03eb-fb9b-4abd-aab9-99ec6b5ebb51", "content-length": "682", "date": "Fri, 15 Nov 2024 21:50:23 GMT"} })
52562024-11-15T21:50:23.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52572024-11-15T21:50:23.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52582024-11-15T21:50:23.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52592024-11-15T21:50:23.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52602024-11-15T21:50:23.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52612024-11-15T21:50:23.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52622024-11-15T21:50:23.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52632024-11-15T21:50:23.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52642024-11-15T21:50:23.769ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 737.575057ms iteration = 17 status = {}
52652024-11-15T21:50:24.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = c03071fe-b1b6-47a3-b016-4cb3a7e99216 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
52662024-11-15T21:50:24.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = c03071fe-b1b6-47a3-b016-4cb3a7e99216 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
52672024-11-15T21:50:24.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = c03071fe-b1b6-47a3-b016-4cb3a7e99216 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
52682024-11-15T21:50:24.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2305abb2-bc6d-4c97-abcd-5c125e3c185d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52692024-11-15T21:50:24.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2305abb2-bc6d-4c97-abcd-5c125e3c185d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52702024-11-15T21:50:24.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2305abb2-bc6d-4c97-abcd-5c125e3c185d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52712024-11-15T21:50:24.775ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50156
52722024-11-15T21:50:24.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50156 req_id = de1c33dd-ae69-4df5-b575-a8be5c549813 roles = RoleSet { roles: {} } uri = /metrics/producers
52732024-11-15T21:50:24.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50156 req_id = de1c33dd-ae69-4df5-b575-a8be5c549813 resource = Database result = Ok(()) uri = /metrics/producers
52742024-11-15T21:50:24.809ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 17a6b664-61ae-47e8-9c94-fdc7e3f8e300
52752024-11-15T21:50:24.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34359 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50156 req_id = de1c33dd-ae69-4df5-b575-a8be5c549813 response_code = 201 uri = /metrics/producers
52762024-11-15T21:50:24.964ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47646
52772024-11-15T21:50:24.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47646 req_id = f02dfe52-ccc5-4b21-9d1d-b27528df6b6a roles = RoleSet { roles: {} } uri = /metrics/producers
52782024-11-15T21:50:24.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47646 req_id = f02dfe52-ccc5-4b21-9d1d-b27528df6b6a resource = Database result = Ok(()) uri = /metrics/producers
52792024-11-15T21:50:25.008ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 1ee9a34a-c3be-49f8-8ccd-8456768402b0
52802024-11-15T21:50:25.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44213 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47646 req_id = f02dfe52-ccc5-4b21-9d1d-b27528df6b6a response_code = 201 uri = /metrics/producers
52812024-11-15T21:50:25.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a313bdc2-756c-44ed-a3fe-a0012cbd5488 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52822024-11-15T21:50:25.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a313bdc2-756c-44ed-a3fe-a0012cbd5488 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52832024-11-15T21:50:25.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a313bdc2-756c-44ed-a3fe-a0012cbd5488 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52842024-11-15T21:50:26.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c6f4644e-1add-4cc6-9f85-8429d396e83e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52852024-11-15T21:50:26.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c6f4644e-1add-4cc6-9f85-8429d396e83e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52862024-11-15T21:50:26.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c6f4644e-1add-4cc6-9f85-8429d396e83e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52872024-11-15T21:50:27.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b759d306-809a-4722-a1e2-9315aefcd0a9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52882024-11-15T21:50:27.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b759d306-809a-4722-a1e2-9315aefcd0a9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52892024-11-15T21:50:27.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b759d306-809a-4722-a1e2-9315aefcd0a9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52902024-11-15T21:50:28.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1668c107-6af4-4bd2-86bd-6482eae83c66 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52912024-11-15T21:50:28.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1668c107-6af4-4bd2-86bd-6482eae83c66 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52922024-11-15T21:50:28.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1668c107-6af4-4bd2-86bd-6482eae83c66 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52932024-11-15T21:50:29.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 170431ed-304b-4dd4-9081-855893a11b50 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52942024-11-15T21:50:29.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 170431ed-304b-4dd4-9081-855893a11b50 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52952024-11-15T21:50:29.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 170431ed-304b-4dd4-9081-855893a11b50 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52962024-11-15T21:50:30.675ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = f3b6e966-82b5-4d43-ae89-d9abd8c74267 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
52972024-11-15T21:50:30.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = abd0deb8-04b7-4fba-9de3-79bcdfb012b6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52982024-11-15T21:50:30.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = abd0deb8-04b7-4fba-9de3-79bcdfb012b6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
52992024-11-15T21:50:30.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = abd0deb8-04b7-4fba-9de3-79bcdfb012b6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53002024-11-15T21:50:31.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7365959b-283a-4875-9b7a-c80e1601ae81 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53012024-11-15T21:50:31.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7365959b-283a-4875-9b7a-c80e1601ae81 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53022024-11-15T21:50:31.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7365959b-283a-4875-9b7a-c80e1601ae81 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53032024-11-15T21:50:32.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 61d54583-dc9c-486f-a2c4-b24dfe5640f6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53042024-11-15T21:50:32.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 61d54583-dc9c-486f-a2c4-b24dfe5640f6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53052024-11-15T21:50:32.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 61d54583-dc9c-486f-a2c4-b24dfe5640f6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53062024-11-15T21:50:33.031ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
53072024-11-15T21:50:33.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
53082024-11-15T21:50:33.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53092024-11-15T21:50:33.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53102024-11-15T21:50:33.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53112024-11-15T21:50:33.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53122024-11-15T21:50:33.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53132024-11-15T21:50:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53142024-11-15T21:50:33.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53152024-11-15T21:50:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53162024-11-15T21:50:33.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53172024-11-15T21:50:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53182024-11-15T21:50:33.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53192024-11-15T21:50:33.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
53202024-11-15T21:50:33.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53212024-11-15T21:50:33.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53222024-11-15T21:50:33.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
53232024-11-15T21:50:33.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.088033ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
53242024-11-15T21:50:33.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53252024-11-15T21:50:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53262024-11-15T21:50:33.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.310205ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53272024-11-15T21:50:33.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cfc52306-e1b5-4843-adf7-ef8d99bc6c0f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53282024-11-15T21:50:33.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cfc52306-e1b5-4843-adf7-ef8d99bc6c0f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53292024-11-15T21:50:33.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cfc52306-e1b5-4843-adf7-ef8d99bc6c0f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53302024-11-15T21:50:34.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c08517ae-1702-42d9-85ff-565470400490 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53312024-11-15T21:50:34.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c08517ae-1702-42d9-85ff-565470400490 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53322024-11-15T21:50:34.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c08517ae-1702-42d9-85ff-565470400490 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53332024-11-15T21:50:35.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 19e46869-8a1a-48e2-af05-eeb640f80d19 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
53342024-11-15T21:50:35.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 19e46869-8a1a-48e2-af05-eeb640f80d19 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
53352024-11-15T21:50:35.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 19e46869-8a1a-48e2-af05-eeb640f80d19 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
53362024-11-15T21:50:35.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 8a5f8d64-69d0-40d6-886a-18dcb4b4b778 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
53372024-11-15T21:50:35.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 8a5f8d64-69d0-40d6-886a-18dcb4b4b778 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
53382024-11-15T21:50:35.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 8a5f8d64-69d0-40d6-886a-18dcb4b4b778 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
53392024-11-15T21:50:35.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5e878316-9cc2-45b1-9a29-6adb6ffd9e35 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53402024-11-15T21:50:35.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5e878316-9cc2-45b1-9a29-6adb6ffd9e35 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53412024-11-15T21:50:35.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5e878316-9cc2-45b1-9a29-6adb6ffd9e35 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53422024-11-15T21:50:36.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0abed86d-f63e-42fa-bec0-88bd030def17 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53432024-11-15T21:50:36.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0abed86d-f63e-42fa-bec0-88bd030def17 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53442024-11-15T21:50:36.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0abed86d-f63e-42fa-bec0-88bd030def17 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53452024-11-15T21:50:37.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 573049ad-b62e-485c-b342-c8c3ff64bdf2 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53462024-11-15T21:50:37.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 573049ad-b62e-485c-b342-c8c3ff64bdf2 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53472024-11-15T21:50:37.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 573049ad-b62e-485c-b342-c8c3ff64bdf2 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53482024-11-15T21:50:38.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 72ffe30d-c785-4889-a781-6d09bd83e98a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53492024-11-15T21:50:38.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 72ffe30d-c785-4889-a781-6d09bd83e98a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53502024-11-15T21:50:39.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 72ffe30d-c785-4889-a781-6d09bd83e98a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53512024-11-15T21:50:40.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a81ace26-4398-473d-8428-07f39473b654 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53522024-11-15T21:50:40.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a81ace26-4398-473d-8428-07f39473b654 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53532024-11-15T21:50:40.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a81ace26-4398-473d-8428-07f39473b654 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53542024-11-15T21:50:41.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8841a91a-1c69-4e64-bbb4-27e9905bc6ea roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53552024-11-15T21:50:41.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8841a91a-1c69-4e64-bbb4-27e9905bc6ea resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53562024-11-15T21:50:41.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8841a91a-1c69-4e64-bbb4-27e9905bc6ea response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53572024-11-15T21:50:42.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a7718660-c037-4455-af01-648fd6779356 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53582024-11-15T21:50:42.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a7718660-c037-4455-af01-648fd6779356 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53592024-11-15T21:50:42.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a7718660-c037-4455-af01-648fd6779356 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53602024-11-15T21:50:43.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
53612024-11-15T21:50:43.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
53622024-11-15T21:50:43.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53632024-11-15T21:50:43.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53642024-11-15T21:50:43.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53652024-11-15T21:50:43.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53662024-11-15T21:50:43.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53672024-11-15T21:50:43.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53682024-11-15T21:50:43.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53692024-11-15T21:50:43.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53702024-11-15T21:50:43.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53712024-11-15T21:50:43.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53722024-11-15T21:50:43.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53732024-11-15T21:50:43.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
53742024-11-15T21:50:43.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53752024-11-15T21:50:43.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53762024-11-15T21:50:43.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
53772024-11-15T21:50:43.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.487703ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
53782024-11-15T21:50:43.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53792024-11-15T21:50:43.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53802024-11-15T21:50:43.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5f0782b0-a1f8-487f-8520-7778ce639620 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53812024-11-15T21:50:43.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5f0782b0-a1f8-487f-8520-7778ce639620 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53822024-11-15T21:50:43.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5f0782b0-a1f8-487f-8520-7778ce639620 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53832024-11-15T21:50:43.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.222595ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53842024-11-15T21:50:44.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f77b318e-b7a7-43bb-8250-577b797caea3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53852024-11-15T21:50:44.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f77b318e-b7a7-43bb-8250-577b797caea3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53862024-11-15T21:50:44.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f77b318e-b7a7-43bb-8250-577b797caea3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53872024-11-15T21:50:45.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5330b71f-a0a5-4890-90be-19a51d4a86e5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53882024-11-15T21:50:45.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5330b71f-a0a5-4890-90be-19a51d4a86e5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53892024-11-15T21:50:45.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5330b71f-a0a5-4890-90be-19a51d4a86e5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53902024-11-15T21:50:45.494ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56656
53912024-11-15T21:50:45.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56656 req_id = a07029a7-b9b2-4249-b4ec-fa484ae5763d roles = RoleSet { roles: {} } uri = /metrics/producers
53922024-11-15T21:50:45.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56656 req_id = a07029a7-b9b2-4249-b4ec-fa484ae5763d resource = Database result = Ok(()) uri = /metrics/producers
53932024-11-15T21:50:45.504ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 97598fa2-4ef4-4fda-9111-75c99f8284f6
53942024-11-15T21:50:45.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10485 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56656 req_id = a07029a7-b9b2-4249-b4ec-fa484ae5763d response_code = 201 uri = /metrics/producers
53952024-11-15T21:50:45.672ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1499 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 876310a4-d1c8-4930-9157-51369ff6a65b response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
53962024-11-15T21:50:46.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 740984f6-1df5-4fd6-8530-0eea6d80d6c4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53972024-11-15T21:50:46.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 740984f6-1df5-4fd6-8530-0eea6d80d6c4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53982024-11-15T21:50:46.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 740984f6-1df5-4fd6-8530-0eea6d80d6c4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
53992024-11-15T21:50:47.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 67303612-90d7-4208-8097-8ae830c7af0e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54002024-11-15T21:50:47.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 67303612-90d7-4208-8097-8ae830c7af0e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54012024-11-15T21:50:47.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 67303612-90d7-4208-8097-8ae830c7af0e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54022024-11-15T21:50:48.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e76e7942-ed9d-4fbf-98dd-0bde6a316c7d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54032024-11-15T21:50:48.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e76e7942-ed9d-4fbf-98dd-0bde6a316c7d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54042024-11-15T21:50:48.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e76e7942-ed9d-4fbf-98dd-0bde6a316c7d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54052024-11-15T21:50:49.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4375c9e0-900b-4a46-a7db-6f76d28ed34b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54062024-11-15T21:50:49.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4375c9e0-900b-4a46-a7db-6f76d28ed34b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54072024-11-15T21:50:49.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4375c9e0-900b-4a46-a7db-6f76d28ed34b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54082024-11-15T21:50:50.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6ee4644d-134e-4ca1-b715-05e164d6e2e0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54092024-11-15T21:50:50.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6ee4644d-134e-4ca1-b715-05e164d6e2e0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54102024-11-15T21:50:50.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6ee4644d-134e-4ca1-b715-05e164d6e2e0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54112024-11-15T21:50:51.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 28430e75-1fcd-4c34-9ebd-4cf22275a669 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54122024-11-15T21:50:51.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 28430e75-1fcd-4c34-9ebd-4cf22275a669 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54132024-11-15T21:50:51.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 28430e75-1fcd-4c34-9ebd-4cf22275a669 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54142024-11-15T21:50:52.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7dd32aa7-42ac-48e5-9cf4-0b958864a169 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54152024-11-15T21:50:52.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7dd32aa7-42ac-48e5-9cf4-0b958864a169 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54162024-11-15T21:50:52.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7dd32aa7-42ac-48e5-9cf4-0b958864a169 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
54172024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
54182024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
54192024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54202024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54212024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
54222024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
54232024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54242024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
54252024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
54262024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54272024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
54282024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54292024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54302024-11-15T21:50:53.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
54312024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54322024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54332024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
54342024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54352024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
54362024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54372024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
54382024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54392024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
54402024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54412024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
54422024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
54432024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
54442024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54452024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54462024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54472024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
54482024-11-15T21:50:53.029ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54492024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54502024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
54512024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54522024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54532024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54542024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54552024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54562024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54572024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54582024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54592024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54602024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54612024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54622024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54632024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54642024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54652024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54662024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54672024-11-15T21:50:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54682024-11-15T21:50:53.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54692024-11-15T21:50:53.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54702024-11-15T21:50:53.033ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.218947ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54712024-11-15T21:50:53.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54722024-11-15T21:50:53.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54732024-11-15T21:50:53.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54742024-11-15T21:50:53.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54752024-11-15T21:50:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54762024-11-15T21:50:53.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54772024-11-15T21:50:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54782024-11-15T21:50:53.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54792024-11-15T21:50:53.036ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54802024-11-15T21:50:53.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54812024-11-15T21:50:53.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1534, tv_nsec: 981320022 } })
54822024-11-15T21:50:53.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
54832024-11-15T21:50:53.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54842024-11-15T21:50:53.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54852024-11-15T21:50:53.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54862024-11-15T21:50:53.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54872024-11-15T21:50:53.044ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1534, tv_nsec: 987777304 } })
54882024-11-15T21:50:53.044ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
54892024-11-15T21:50:53.045ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54902024-11-15T21:50:53.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54912024-11-15T21:50:53.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54922024-11-15T21:50:53.045ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1534, tv_nsec: 989720476 } })
54932024-11-15T21:50:53.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54942024-11-15T21:50:53.046ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
54952024-11-15T21:50:53.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54962024-11-15T21:50:53.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54972024-11-15T21:50:53.050ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54982024-11-15T21:50:53.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54992024-11-15T21:50:53.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 36.248845ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
55002024-11-15T21:50:53.073ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55012024-11-15T21:50:53.073ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55022024-11-15T21:50:53.073ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55032024-11-15T21:50:53.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55042024-11-15T21:50:53.076ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55052024-11-15T21:50:53.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55062024-11-15T21:50:53.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55072024-11-15T21:50:53.078ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55082024-11-15T21:50:53.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55092024-11-15T21:50:53.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55102024-11-15T21:50:53.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55112024-11-15T21:50:53.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55122024-11-15T21:50:53.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55132024-11-15T21:50:53.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55142024-11-15T21:50:53.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55152024-11-15T21:50:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55162024-11-15T21:50:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55172024-11-15T21:50:53.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55182024-11-15T21:50:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55192024-11-15T21:50:53.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55202024-11-15T21:50:53.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55212024-11-15T21:50:53.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55222024-11-15T21:50:53.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55232024-11-15T21:50:53.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55242024-11-15T21:50:53.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55252024-11-15T21:50:53.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55262024-11-15T21:50:53.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55272024-11-15T21:50:53.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55282024-11-15T21:50:53.088ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55292024-11-15T21:50:53.088ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.414886ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55302024-11-15T21:50:53.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.294211ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
55312024-11-15T21:50:53.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55322024-11-15T21:50:53.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55332024-11-15T21:50:53.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.026866ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55342024-11-15T21:50:53.113ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55352024-11-15T21:50:53.113ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55362024-11-15T21:50:53.113ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55372024-11-15T21:50:53.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55382024-11-15T21:50:53.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.114253ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55392024-11-15T21:50:53.113ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55402024-11-15T21:50:53.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55412024-11-15T21:50:53.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.888902ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55422024-11-15T21:50:53.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55432024-11-15T21:50:53.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55442024-11-15T21:50:53.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
55452024-11-15T21:50:53.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55462024-11-15T21:50:53.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
55472024-11-15T21:50:53.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55482024-11-15T21:50:53.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55492024-11-15T21:50:53.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55502024-11-15T21:50:53.134ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.493175ms iteration = 18 status = 0
55512024-11-15T21:50:53.141ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
55522024-11-15T21:50:53.145ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55532024-11-15T21:50:53.146ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd4a6f6b-309d-4bac-8f48-388868ca725b", "content-length": "26", "date": "Fri, 15 Nov 2024 21:50:52 GMT"} })
55542024-11-15T21:50:53.146ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55552024-11-15T21:50:53.146ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
55562024-11-15T21:50:53.146ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 117.968855ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
55572024-11-15T21:50:53.148ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55582024-11-15T21:50:53.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55592024-11-15T21:50:53.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55602024-11-15T21:50:53.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 126.715742ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55612024-11-15T21:50:53.156ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.214946ms iteration = 21 status = {"physical_disks_added":0}
55622024-11-15T21:50:53.160ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55632024-11-15T21:50:53.160ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55642024-11-15T21:50:53.160ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 131.954486ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55652024-11-15T21:50:53.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55662024-11-15T21:50:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55672024-11-15T21:50:53.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55682024-11-15T21:50:53.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55692024-11-15T21:50:53.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55702024-11-15T21:50:53.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55712024-11-15T21:50:53.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55722024-11-15T21:50:53.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55732024-11-15T21:50:53.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55742024-11-15T21:50:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55752024-11-15T21:50:53.292ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55762024-11-15T21:50:53.292ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55772024-11-15T21:50:53.308ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
55782024-11-15T21:50:53.308ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55792024-11-15T21:50:53.309ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0607c8dc-dbcd-4702-8b78-e0bc3f32e6e0", "content-length": "26", "date": "Fri, 15 Nov 2024 21:50:52 GMT"} })
55802024-11-15T21:50:53.309ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55812024-11-15T21:50:53.310ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55822024-11-15T21:50:53.313ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
55832024-11-15T21:50:53.313ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55842024-11-15T21:50:53.313ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53ca2a5d-8857-4b6f-bd44-70bbf2147eba", "content-length": "26", "date": "Fri, 15 Nov 2024 21:50:52 GMT"} })
55852024-11-15T21:50:53.313ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55862024-11-15T21:50:53.315ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
55872024-11-15T21:50:53.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b19f961-7097-4b79-8dca-cddbd7273054 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
55882024-11-15T21:50:53.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b19f961-7097-4b79-8dca-cddbd7273054 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
55892024-11-15T21:50:53.327ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "92a37cdd-c990-4320-8982-a3fc973136fa", "content-length": "372", "date": "Fri, 15 Nov 2024 21:50:52 GMT"} })
55902024-11-15T21:50:53.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55912024-11-15T21:50:53.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55922024-11-15T21:50:53.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b19f961-7097-4b79-8dca-cddbd7273054 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
55932024-11-15T21:50:53.377ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55942024-11-15T21:50:53.377ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5660099b-6a76-49aa-9271-e0dc65dd2090", "content-length": "691", "date": "Fri, 15 Nov 2024 21:50:53 GMT"} })
55952024-11-15T21:50:53.377ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55962024-11-15T21:50:53.377ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55972024-11-15T21:50:53.377ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55982024-11-15T21:50:53.379ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 350.325504ms iteration = 18 status = {}
55992024-11-15T21:50:53.417ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
56002024-11-15T21:50:53.417ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56012024-11-15T21:50:53.417ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0771cbdf-2edf-439a-902e-7b468806b1ca", "date": "Fri, 15 Nov 2024 21:50:53 GMT"} })
56022024-11-15T21:50:53.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56032024-11-15T21:50:53.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56042024-11-15T21:50:53.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56052024-11-15T21:50:53.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56062024-11-15T21:50:53.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56072024-11-15T21:50:53.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56082024-11-15T21:50:53.427ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56092024-11-15T21:50:53.427ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56102024-11-15T21:50:53.427ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ab220a86-26e8-44ee-9650-b49bd4887838", "date": "Fri, 15 Nov 2024 21:50:53 GMT"} })
56112024-11-15T21:50:53.429ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 400.487179ms iteration = 19 status = {}
56122024-11-15T21:50:53.481ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 452.372977ms iteration = 18 status = {}
56132024-11-15T21:50:53.542ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56142024-11-15T21:50:53.542ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fa43338-c607-46ef-b622-2033822c5645", "content-length": "1", "date": "Fri, 15 Nov 2024 21:50:52 GMT"} })
56152024-11-15T21:50:53.544ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56162024-11-15T21:50:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56172024-11-15T21:50:53.546ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 517.569709ms iteration = 18 status = null
56182024-11-15T21:50:53.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56192024-11-15T21:50:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56202024-11-15T21:50:53.606ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
56212024-11-15T21:50:53.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56222024-11-15T21:50:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56232024-11-15T21:50:53.615ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56242024-11-15T21:50:53.615ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0c1b6bd-c48c-41e2-8bbe-07b8b3f9edf5", "content-length": "134", "date": "Fri, 15 Nov 2024 21:50:52 GMT"} })
56252024-11-15T21:50:53.615ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56262024-11-15T21:50:53.615ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
56272024-11-15T21:50:53.615ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56282024-11-15T21:50:53.615ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56292024-11-15T21:50:53.615ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56302024-11-15T21:50:53.615ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56312024-11-15T21:50:53.615ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56322024-11-15T21:50:53.615ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56332024-11-15T21:50:53.616ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56342024-11-15T21:50:53.616ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56352024-11-15T21:50:53.616ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
56362024-11-15T21:50:53.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56372024-11-15T21:50:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56382024-11-15T21:50:53.617ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56392024-11-15T21:50:53.617ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "094dcba7-4c9d-48a9-9d80-7cc1656f1f9f", "content-length": "2", "date": "Fri, 15 Nov 2024 21:50:52 GMT"} })
56402024-11-15T21:50:53.618ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56412024-11-15T21:50:53.618ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea87358c-0837-4922-92a5-4c6d8b2087d0", "content-length": "52", "date": "Fri, 15 Nov 2024 21:50:52 GMT"} })
56422024-11-15T21:50:53.618ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
56432024-11-15T21:50:53.618ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56442024-11-15T21:50:53.716ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1ee81bb7-b8e6-46b8-b578-d19c5b9529bd", "date": "Fri, 15 Nov 2024 21:50:53 GMT"} })
56452024-11-15T21:50:53.716ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
56462024-11-15T21:50:53.716ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56472024-11-15T21:50:53.717ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "084aadf0-d353-4840-9fe0-c7ce7b34e578", "content-length": "682", "date": "Fri, 15 Nov 2024 21:50:53 GMT"} })
56482024-11-15T21:50:53.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56492024-11-15T21:50:53.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56502024-11-15T21:50:53.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56512024-11-15T21:50:53.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56522024-11-15T21:50:53.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56532024-11-15T21:50:53.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56542024-11-15T21:50:53.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56552024-11-15T21:50:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56562024-11-15T21:50:53.734ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 705.936341ms iteration = 18 status = {}
56572024-11-15T21:50:54.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 49f9546b-14d7-42f0-82a4-cdb43010ecaa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
56582024-11-15T21:50:54.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 49f9546b-14d7-42f0-82a4-cdb43010ecaa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
56592024-11-15T21:50:54.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 49f9546b-14d7-42f0-82a4-cdb43010ecaa response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
56602024-11-15T21:50:54.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ae68fdb6-873d-4ed8-bdc1-521994e826f8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56612024-11-15T21:50:54.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ae68fdb6-873d-4ed8-bdc1-521994e826f8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56622024-11-15T21:50:54.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ae68fdb6-873d-4ed8-bdc1-521994e826f8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56632024-11-15T21:50:55.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31aea64b-f85e-4af2-a2b4-d3558309a141 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56642024-11-15T21:50:55.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31aea64b-f85e-4af2-a2b4-d3558309a141 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56652024-11-15T21:50:55.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31aea64b-f85e-4af2-a2b4-d3558309a141 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56662024-11-15T21:50:56.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1d908f07-9c12-4b70-98a6-734bf3be9e54 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56672024-11-15T21:50:56.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1d908f07-9c12-4b70-98a6-734bf3be9e54 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56682024-11-15T21:50:56.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1d908f07-9c12-4b70-98a6-734bf3be9e54 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56692024-11-15T21:50:57.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 771804d3-3126-4a9f-b558-da8aeb34243b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56702024-11-15T21:50:57.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 771804d3-3126-4a9f-b558-da8aeb34243b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56712024-11-15T21:50:57.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 771804d3-3126-4a9f-b558-da8aeb34243b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56722024-11-15T21:50:58.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4a71f40d-4813-4fca-9b22-d27c758ee0ec roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56732024-11-15T21:50:58.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4a71f40d-4813-4fca-9b22-d27c758ee0ec resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56742024-11-15T21:50:58.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4a71f40d-4813-4fca-9b22-d27c758ee0ec response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56752024-11-15T21:50:58.640ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:60252
56762024-11-15T21:50:58.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60252 req_id = 45a9beaa-42a5-4440-913f-0dcb012f42bf roles = RoleSet { roles: {} } uri = /metrics/producers
56772024-11-15T21:50:58.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60252 req_id = 45a9beaa-42a5-4440-913f-0dcb012f42bf resource = Database result = Ok(()) uri = /metrics/producers
56782024-11-15T21:50:58.677ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 54270a8d-942f-4159-a4b4-d6745626c749
56792024-11-15T21:50:58.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36779 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60252 req_id = 45a9beaa-42a5-4440-913f-0dcb012f42bf response_code = 201 uri = /metrics/producers
56802024-11-15T21:50:59.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 030fe29f-7dac-4aa4-b218-e4164f82b471 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56812024-11-15T21:50:59.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 030fe29f-7dac-4aa4-b218-e4164f82b471 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56822024-11-15T21:50:59.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 030fe29f-7dac-4aa4-b218-e4164f82b471 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56832024-11-15T21:51:00.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c65a2e33-908b-4484-9000-6605c4d97ded roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56842024-11-15T21:51:00.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c65a2e33-908b-4484-9000-6605c4d97ded resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56852024-11-15T21:51:00.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c65a2e33-908b-4484-9000-6605c4d97ded response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56862024-11-15T21:51:00.669ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1490 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 610a7a09-0f24-4585-afda-8e3081fa4f0b response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
56872024-11-15T21:51:01.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a231de74-e7dd-45ee-8a34-561034b46102 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56882024-11-15T21:51:01.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a231de74-e7dd-45ee-8a34-561034b46102 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56892024-11-15T21:51:01.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a231de74-e7dd-45ee-8a34-561034b46102 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56902024-11-15T21:51:02.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b01f552d-1ce0-4bc8-844e-e5053a7dc7d5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56912024-11-15T21:51:02.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b01f552d-1ce0-4bc8-844e-e5053a7dc7d5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56922024-11-15T21:51:02.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b01f552d-1ce0-4bc8-844e-e5053a7dc7d5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
56932024-11-15T21:51:03.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
56942024-11-15T21:51:03.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
56952024-11-15T21:51:03.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56962024-11-15T21:51:03.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56972024-11-15T21:51:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56982024-11-15T21:51:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56992024-11-15T21:51:03.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57002024-11-15T21:51:03.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57012024-11-15T21:51:03.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57022024-11-15T21:51:03.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.063062ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57032024-11-15T21:51:03.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57042024-11-15T21:51:03.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57052024-11-15T21:51:03.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57062024-11-15T21:51:03.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57072024-11-15T21:51:03.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57082024-11-15T21:51:03.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57092024-11-15T21:51:03.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
57102024-11-15T21:51:03.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57112024-11-15T21:51:03.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57122024-11-15T21:51:03.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
57132024-11-15T21:51:03.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.866587ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
57142024-11-15T21:51:03.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 73535b4e-02ed-4b84-847f-5b5a74d4cded roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57152024-11-15T21:51:03.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 73535b4e-02ed-4b84-847f-5b5a74d4cded resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57162024-11-15T21:51:03.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 73535b4e-02ed-4b84-847f-5b5a74d4cded response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57172024-11-15T21:51:04.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba82bd7b-0362-4cd5-8b0b-ab3fd5a87c8d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57182024-11-15T21:51:04.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba82bd7b-0362-4cd5-8b0b-ab3fd5a87c8d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57192024-11-15T21:51:04.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba82bd7b-0362-4cd5-8b0b-ab3fd5a87c8d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57202024-11-15T21:51:05.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d994c250-1fac-45dd-987f-c4af17f3a9bd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57212024-11-15T21:51:05.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d994c250-1fac-45dd-987f-c4af17f3a9bd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57222024-11-15T21:51:05.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d994c250-1fac-45dd-987f-c4af17f3a9bd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57232024-11-15T21:51:05.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 59361554-07e6-40f7-aca3-8afe597b1ef0 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
57242024-11-15T21:51:05.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 59361554-07e6-40f7-aca3-8afe597b1ef0 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
57252024-11-15T21:51:05.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 59361554-07e6-40f7-aca3-8afe597b1ef0 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
57262024-11-15T21:51:05.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = cb3762bc-20c0-4423-97b4-ae1789e66a7f roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
57272024-11-15T21:51:05.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = cb3762bc-20c0-4423-97b4-ae1789e66a7f resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
57282024-11-15T21:51:05.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = cb3762bc-20c0-4423-97b4-ae1789e66a7f response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
57292024-11-15T21:51:06.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f61ee375-333e-4845-bc7d-aae5c2154157 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57302024-11-15T21:51:06.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f61ee375-333e-4845-bc7d-aae5c2154157 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57312024-11-15T21:51:06.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f61ee375-333e-4845-bc7d-aae5c2154157 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57322024-11-15T21:51:07.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c390bbea-3ee9-432a-8992-faa0d6e7e2e0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57332024-11-15T21:51:07.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c390bbea-3ee9-432a-8992-faa0d6e7e2e0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57342024-11-15T21:51:07.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c390bbea-3ee9-432a-8992-faa0d6e7e2e0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57352024-11-15T21:51:08.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e70a6173-c0fa-40c0-b0e8-71650f4f1de7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57362024-11-15T21:51:08.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e70a6173-c0fa-40c0-b0e8-71650f4f1de7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57372024-11-15T21:51:08.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e70a6173-c0fa-40c0-b0e8-71650f4f1de7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57382024-11-15T21:51:09.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c39cd3f3-2968-46e6-8980-6dd417cad326 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57392024-11-15T21:51:09.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c39cd3f3-2968-46e6-8980-6dd417cad326 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57402024-11-15T21:51:09.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c39cd3f3-2968-46e6-8980-6dd417cad326 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57412024-11-15T21:51:10.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2cb6dc3d-8a3f-472f-9fbd-7abb9c29ad61 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57422024-11-15T21:51:10.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2cb6dc3d-8a3f-472f-9fbd-7abb9c29ad61 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57432024-11-15T21:51:10.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2cb6dc3d-8a3f-472f-9fbd-7abb9c29ad61 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57442024-11-15T21:51:11.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 259ed1f1-38d2-43f8-bffd-a1430e57080c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57452024-11-15T21:51:11.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 259ed1f1-38d2-43f8-bffd-a1430e57080c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57462024-11-15T21:51:11.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 259ed1f1-38d2-43f8-bffd-a1430e57080c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57472024-11-15T21:51:12.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c3502f77-c8db-4e29-9179-5b6f1b9a06fa roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57482024-11-15T21:51:12.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c3502f77-c8db-4e29-9179-5b6f1b9a06fa resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57492024-11-15T21:51:12.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c3502f77-c8db-4e29-9179-5b6f1b9a06fa response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57502024-11-15T21:51:13.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
57512024-11-15T21:51:13.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
57522024-11-15T21:51:13.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57532024-11-15T21:51:13.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57542024-11-15T21:51:13.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57552024-11-15T21:51:13.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57562024-11-15T21:51:13.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57572024-11-15T21:51:13.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57582024-11-15T21:51:13.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57592024-11-15T21:51:13.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57602024-11-15T21:51:13.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57612024-11-15T21:51:13.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57622024-11-15T21:51:13.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57632024-11-15T21:51:13.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
57642024-11-15T21:51:13.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57652024-11-15T21:51:13.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57662024-11-15T21:51:13.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
57672024-11-15T21:51:13.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.285765ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
57682024-11-15T21:51:13.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57692024-11-15T21:51:13.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57702024-11-15T21:51:13.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.554113ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57712024-11-15T21:51:13.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 19033c56-6eac-4b19-9dba-16bfb6616590 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57722024-11-15T21:51:13.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 19033c56-6eac-4b19-9dba-16bfb6616590 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57732024-11-15T21:51:13.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 19033c56-6eac-4b19-9dba-16bfb6616590 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57742024-11-15T21:51:14.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 84155036-86f1-41d6-9c10-d5f50b02495b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57752024-11-15T21:51:14.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 84155036-86f1-41d6-9c10-d5f50b02495b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57762024-11-15T21:51:14.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 84155036-86f1-41d6-9c10-d5f50b02495b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57772024-11-15T21:51:15.670ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = af272b4c-1911-4b4f-b4ec-040a9e3f0579 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
57782024-11-15T21:51:15.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 80d30d8b-2ff8-4dd3-912c-047982c51fb4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57792024-11-15T21:51:15.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 80d30d8b-2ff8-4dd3-912c-047982c51fb4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57802024-11-15T21:51:15.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 80d30d8b-2ff8-4dd3-912c-047982c51fb4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57812024-11-15T21:51:16.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3bfa0581-e4f0-4182-9cf3-2d3460a81a4f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57822024-11-15T21:51:16.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3bfa0581-e4f0-4182-9cf3-2d3460a81a4f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57832024-11-15T21:51:16.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3bfa0581-e4f0-4182-9cf3-2d3460a81a4f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57842024-11-15T21:51:17.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9ffab872-e0ca-4fdf-8d11-bffdcf0317b0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57852024-11-15T21:51:17.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9ffab872-e0ca-4fdf-8d11-bffdcf0317b0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57862024-11-15T21:51:17.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9ffab872-e0ca-4fdf-8d11-bffdcf0317b0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57872024-11-15T21:51:18.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31e8b1cb-852e-49b7-94e2-16a30a9a0a99 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57882024-11-15T21:51:18.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31e8b1cb-852e-49b7-94e2-16a30a9a0a99 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57892024-11-15T21:51:18.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31e8b1cb-852e-49b7-94e2-16a30a9a0a99 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57902024-11-15T21:51:19.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a4ff33d2-683a-4852-8561-6a6fb7b26a98 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57912024-11-15T21:51:19.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a4ff33d2-683a-4852-8561-6a6fb7b26a98 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57922024-11-15T21:51:19.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a4ff33d2-683a-4852-8561-6a6fb7b26a98 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
57932024-11-15T21:51:20.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = f0172a57-5d2c-4140-a5b4-49a30aaa5e1c roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
57942024-11-15T21:51:20.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = f0172a57-5d2c-4140-a5b4-49a30aaa5e1c resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
57952024-11-15T21:51:20.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = f0172a57-5d2c-4140-a5b4-49a30aaa5e1c response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
57962024-11-15T21:51:20.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = e40b669a-0b48-48de-ad07-314374a1b770 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
57972024-11-15T21:51:20.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = e40b669a-0b48-48de-ad07-314374a1b770 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
57982024-11-15T21:51:20.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = e40b669a-0b48-48de-ad07-314374a1b770 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
57992024-11-15T21:51:20.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = df83c4bc-6fba-4748-a2af-9a5e14d0c746 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
58002024-11-15T21:51:20.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = df83c4bc-6fba-4748-a2af-9a5e14d0c746 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
58012024-11-15T21:51:20.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = df83c4bc-6fba-4748-a2af-9a5e14d0c746 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
58022024-11-15T21:51:21.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0983ae47-98b1-40db-940b-db5476459bdb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
58032024-11-15T21:51:21.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0983ae47-98b1-40db-940b-db5476459bdb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
58042024-11-15T21:51:21.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0983ae47-98b1-40db-940b-db5476459bdb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
58052024-11-15T21:51:22.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1c6f9abe-62f9-40fa-8c13-70941e2bd6ce roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
58062024-11-15T21:51:22.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1c6f9abe-62f9-40fa-8c13-70941e2bd6ce resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
58072024-11-15T21:51:23.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1c6f9abe-62f9-40fa-8c13-70941e2bd6ce response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
58082024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
58092024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
58102024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
58112024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
58122024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
58132024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58142024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58152024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
58162024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58172024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
58182024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
58192024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
58202024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58212024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
58222024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58232024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
58242024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
58252024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58262024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
58272024-11-15T21:51:23.032ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58282024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
58292024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58302024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
58312024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
58322024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58332024-11-15T21:51:23.032ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
58342024-11-15T21:51:23.032ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:41:23.032355334 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
58352024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58362024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
58372024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
58382024-11-15T21:51:23.032ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
58392024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
58402024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.07\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
58412024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58422024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
58432024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
58442024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58452024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
58462024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58472024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58482024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
58492024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58502024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58512024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
58522024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
58532024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58542024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
58552024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
58562024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
58572024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58582024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58592024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
58602024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58612024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
58622024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58632024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
58642024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
58652024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
58662024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
58672024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58682024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
58692024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
58702024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58712024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58722024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58732024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58742024-11-15T21:51:23.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58752024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58762024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58772024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58782024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
58792024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58802024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58812024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58822024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58832024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58842024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58852024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58862024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58872024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58882024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58892024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58902024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58912024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58922024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58932024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58942024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58952024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58962024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58972024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58982024-11-15T21:51:23.033ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 974535144 } })
58992024-11-15T21:51:23.033ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 974562734 } })
59002024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59012024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59022024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59032024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59042024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59052024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59062024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
59072024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.373349ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
59082024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
59092024-11-15T21:51:23.033ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.65865ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
59102024-11-15T21:51:23.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59112024-11-15T21:51:23.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59122024-11-15T21:51:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59132024-11-15T21:51:23.036ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.877895ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
59142024-11-15T21:51:23.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59152024-11-15T21:51:23.037ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.408339ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59162024-11-15T21:51:23.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 978313368 } })
59172024-11-15T21:51:23.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
59182024-11-15T21:51:23.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59192024-11-15T21:51:23.038ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59202024-11-15T21:51:23.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59212024-11-15T21:51:23.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59222024-11-15T21:51:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59232024-11-15T21:51:23.039ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:41:23.032355334 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
59242024-11-15T21:51:23.039ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.892695ms iteration = 10 status = {"expiration":"2024-11-15T21:41:23.032355334Z","pruned":[]}
59252024-11-15T21:51:23.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59262024-11-15T21:51:23.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59272024-11-15T21:51:23.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59282024-11-15T21:51:23.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59292024-11-15T21:51:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
59302024-11-15T21:51:23.042ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59312024-11-15T21:51:23.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59322024-11-15T21:51:23.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59332024-11-15T21:51:23.042ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59342024-11-15T21:51:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59352024-11-15T21:51:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59362024-11-15T21:51:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59372024-11-15T21:51:23.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59382024-11-15T21:51:23.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59392024-11-15T21:51:23.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59402024-11-15T21:51:23.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59412024-11-15T21:51:23.048ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 989953814 } })
59422024-11-15T21:51:23.049ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
59432024-11-15T21:51:23.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59442024-11-15T21:51:23.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.172265ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
59452024-11-15T21:51:23.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59462024-11-15T21:51:23.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59472024-11-15T21:51:23.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59482024-11-15T21:51:23.060ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
59492024-11-15T21:51:23.061ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59502024-11-15T21:51:23.061ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 28.385294ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59512024-11-15T21:51:23.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59522024-11-15T21:51:23.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59532024-11-15T21:51:23.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59542024-11-15T21:51:23.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59552024-11-15T21:51:23.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59562024-11-15T21:51:23.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59572024-11-15T21:51:23.099ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59582024-11-15T21:51:23.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59592024-11-15T21:51:23.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59602024-11-15T21:51:23.100ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59612024-11-15T21:51:23.100ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59622024-11-15T21:51:23.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59632024-11-15T21:51:23.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59642024-11-15T21:51:23.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59652024-11-15T21:51:23.103ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59662024-11-15T21:51:23.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59672024-11-15T21:51:23.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59682024-11-15T21:51:23.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.142848ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
59692024-11-15T21:51:23.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59702024-11-15T21:51:23.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59712024-11-15T21:51:23.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 50381516 } })
59722024-11-15T21:51:23.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
59732024-11-15T21:51:23.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59742024-11-15T21:51:23.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59752024-11-15T21:51:23.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59762024-11-15T21:51:23.110ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59772024-11-15T21:51:23.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59782024-11-15T21:51:23.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59792024-11-15T21:51:23.111ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59802024-11-15T21:51:23.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59812024-11-15T21:51:23.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59822024-11-15T21:51:23.113ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59832024-11-15T21:51:23.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59842024-11-15T21:51:23.113ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59852024-11-15T21:51:23.115ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59862024-11-15T21:51:23.115ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59872024-11-15T21:51:23.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59882024-11-15T21:51:23.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59892024-11-15T21:51:23.117ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59902024-11-15T21:51:23.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59912024-11-15T21:51:23.117ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59922024-11-15T21:51:23.117ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59932024-11-15T21:51:23.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59942024-11-15T21:51:23.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
59952024-11-15T21:51:23.119ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59962024-11-15T21:51:23.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59972024-11-15T21:51:23.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59982024-11-15T21:51:23.120ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59992024-11-15T21:51:23.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60002024-11-15T21:51:23.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60012024-11-15T21:51:23.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60022024-11-15T21:51:23.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60032024-11-15T21:51:23.122ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60042024-11-15T21:51:23.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60052024-11-15T21:51:23.123ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60062024-11-15T21:51:23.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
60072024-11-15T21:51:23.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60082024-11-15T21:51:23.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60092024-11-15T21:51:23.125ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
60102024-11-15T21:51:23.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60112024-11-15T21:51:23.126ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60122024-11-15T21:51:23.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60132024-11-15T21:51:23.127ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60142024-11-15T21:51:23.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60152024-11-15T21:51:23.130ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60162024-11-15T21:51:23.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60172024-11-15T21:51:23.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60182024-11-15T21:51:23.133ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60192024-11-15T21:51:23.134ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60202024-11-15T21:51:23.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60212024-11-15T21:51:23.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60222024-11-15T21:51:23.135ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
60232024-11-15T21:51:23.135ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
60242024-11-15T21:51:23.135ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
60252024-11-15T21:51:23.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60262024-11-15T21:51:23.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60272024-11-15T21:51:23.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60282024-11-15T21:51:23.136ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60292024-11-15T21:51:23.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60302024-11-15T21:51:23.140ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 108.273873ms iteration = 5 status = {"nsuccess":5}
60312024-11-15T21:51:23.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60322024-11-15T21:51:23.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60332024-11-15T21:51:23.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60342024-11-15T21:51:23.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60352024-11-15T21:51:23.146ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
60362024-11-15T21:51:23.146ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60372024-11-15T21:51:23.146ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8945c8b-aa8f-419a-82c2-09b613d68540", "content-length": "26", "date": "Fri, 15 Nov 2024 21:51:22 GMT"} })
60382024-11-15T21:51:23.146ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60392024-11-15T21:51:23.148ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60402024-11-15T21:51:23.149ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
60412024-11-15T21:51:23.149ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
60422024-11-15T21:51:23.149ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
60432024-11-15T21:51:23.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60442024-11-15T21:51:23.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60452024-11-15T21:51:23.150ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60462024-11-15T21:51:23.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60472024-11-15T21:51:23.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60482024-11-15T21:51:23.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60492024-11-15T21:51:23.154ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
60502024-11-15T21:51:23.154ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
60512024-11-15T21:51:23.154ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.031702ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
60522024-11-15T21:51:23.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60532024-11-15T21:51:23.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60542024-11-15T21:51:23.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60552024-11-15T21:51:23.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60562024-11-15T21:51:23.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60572024-11-15T21:51:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60582024-11-15T21:51:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60592024-11-15T21:51:23.159ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
60602024-11-15T21:51:23.159ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
60612024-11-15T21:51:23.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60622024-11-15T21:51:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60632024-11-15T21:51:23.160ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
60642024-11-15T21:51:23.160ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 127.991281ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
60652024-11-15T21:51:23.168ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60662024-11-15T21:51:23.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60672024-11-15T21:51:23.169ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
60682024-11-15T21:51:23.169ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60692024-11-15T21:51:23.169ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60702024-11-15T21:51:23.169ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60712024-11-15T21:51:23.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60722024-11-15T21:51:23.170ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfbd9e39-38e6-47fd-94c1-e6883dd92f5f", "content-length": "26", "date": "Fri, 15 Nov 2024 21:51:22 GMT"} })
60732024-11-15T21:51:23.170ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60742024-11-15T21:51:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60752024-11-15T21:51:23.172ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60762024-11-15T21:51:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60772024-11-15T21:51:23.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60782024-11-15T21:51:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
60792024-11-15T21:51:23.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60802024-11-15T21:51:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60812024-11-15T21:51:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60822024-11-15T21:51:23.176ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
60832024-11-15T21:51:23.176ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
60842024-11-15T21:51:23.176ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
60852024-11-15T21:51:23.176ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 143.846454ms iteration = 11 status = {"generation":2}
60862024-11-15T21:51:23.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 144.571589ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60872024-11-15T21:51:23.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 144.661849ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
60882024-11-15T21:51:23.177ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 145.071152ms iteration = 19 status = 0
60892024-11-15T21:51:23.182ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60902024-11-15T21:51:23.182ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60912024-11-15T21:51:23.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60922024-11-15T21:51:23.182ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 149.716031ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60932024-11-15T21:51:23.184ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60942024-11-15T21:51:23.185ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60952024-11-15T21:51:23.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60962024-11-15T21:51:23.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60972024-11-15T21:51:23.186ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60982024-11-15T21:51:23.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60992024-11-15T21:51:23.190ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 157.315151ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61002024-11-15T21:51:23.191ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
61012024-11-15T21:51:23.191ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
61022024-11-15T21:51:23.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61032024-11-15T21:51:23.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61042024-11-15T21:51:23.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61052024-11-15T21:51:23.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61062024-11-15T21:51:23.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61072024-11-15T21:51:23.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61082024-11-15T21:51:23.203ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
61092024-11-15T21:51:23.203ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
61102024-11-15T21:51:23.203ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
61112024-11-15T21:51:23.203ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 170.891059ms iteration = 11 status = {"generation":1}
61122024-11-15T21:51:23.204ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 171.741434ms iteration = 22 status = {"physical_disks_added":0}
61132024-11-15T21:51:23.212ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61142024-11-15T21:51:23.212ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61152024-11-15T21:51:23.212ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 179.768957ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61162024-11-15T21:51:23.223ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 191.236651ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
61172024-11-15T21:51:23.229ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
61182024-11-15T21:51:23.229ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 196.752627ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
61192024-11-15T21:51:23.247ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
61202024-11-15T21:51:23.247ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 214.765854ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
61212024-11-15T21:51:23.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61222024-11-15T21:51:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61232024-11-15T21:51:23.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61242024-11-15T21:51:23.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61252024-11-15T21:51:23.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61262024-11-15T21:51:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61272024-11-15T21:51:23.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61282024-11-15T21:51:23.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61292024-11-15T21:51:23.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61302024-11-15T21:51:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61312024-11-15T21:51:23.341ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61322024-11-15T21:51:23.341ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61332024-11-15T21:51:23.342ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "567cb00d-0fec-4873-ac70-c4353bc7d4e8", "content-length": "372", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} })
61342024-11-15T21:51:23.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61352024-11-15T21:51:23.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61362024-11-15T21:51:23.360ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
61372024-11-15T21:51:23.361ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "aebf7f0b-c732-4263-84e2-01ec7aff3c9e", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61382024-11-15T21:51:23.361ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61392024-11-15T21:51:23.365ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3e7aee1a-2c80-4ea9-9a87-9b5fba289212", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61402024-11-15T21:51:23.365ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61412024-11-15T21:51:23.367ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61422024-11-15T21:51:23.367ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 334.35241ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
61432024-11-15T21:51:23.403ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
61442024-11-15T21:51:23.403ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61452024-11-15T21:51:23.424ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
61462024-11-15T21:51:23.425ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61472024-11-15T21:51:23.425ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91949e93-d6e9-41af-8a1c-d307c6a938e3", "content-length": "26", "date": "Fri, 15 Nov 2024 21:51:22 GMT"} })
61482024-11-15T21:51:23.425ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61492024-11-15T21:51:23.427ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
61502024-11-15T21:51:23.459ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
61512024-11-15T21:51:23.460ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a35d0602-d109-4490-9342-5c84eb15c6c0", "content-length": "1", "date": "Fri, 15 Nov 2024 21:51:22 GMT"} })
61522024-11-15T21:51:23.461ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61532024-11-15T21:51:23.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61542024-11-15T21:51:23.464ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 432.070405ms iteration = 19 status = null
61552024-11-15T21:51:23.466ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
61562024-11-15T21:51:23.469ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61572024-11-15T21:51:23.474ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 442.25314ms iteration = 19 status = {}
61582024-11-15T21:51:23.480ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "19a3bdf9-5cd1-49a8-b106-c08bf88c4168", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} })
61592024-11-15T21:51:23.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61602024-11-15T21:51:23.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61612024-11-15T21:51:23.480ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5a64c2e-5d7b-4a05-b5c1-d51f2a43b83d", "content-length": "691", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} })
61622024-11-15T21:51:23.480ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
61632024-11-15T21:51:23.480ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
61642024-11-15T21:51:23.480ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
61652024-11-15T21:51:23.482ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 450.085302ms iteration = 19 status = {}
61662024-11-15T21:51:23.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61672024-11-15T21:51:23.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61682024-11-15T21:51:23.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61692024-11-15T21:51:23.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61702024-11-15T21:51:23.490ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
61712024-11-15T21:51:23.490ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61722024-11-15T21:51:23.491ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3a60fa4b-d04a-4586-956f-ef5ae9dae247", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} })
61732024-11-15T21:51:23.493ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 460.76307ms iteration = 20 status = {}
61742024-11-15T21:51:23.535ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
61752024-11-15T21:51:23.536ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a8563343-3536-4f59-bd38-277a7e9c7c86", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
61762024-11-15T21:51:23.536ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
61772024-11-15T21:51:23.537ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b950e10d-ee1f-4c7c-ba3a-0b8cea8f4500", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
61782024-11-15T21:51:23.537ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
61792024-11-15T21:51:23.539ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "47aeee52-cc47-4ea7-9cba-e4ba8819e397", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
61802024-11-15T21:51:23.539ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
61812024-11-15T21:51:23.541ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
61822024-11-15T21:51:23.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 509.000935ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
61832024-11-15T21:51:23.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61842024-11-15T21:51:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61852024-11-15T21:51:23.590ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
61862024-11-15T21:51:23.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61872024-11-15T21:51:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61882024-11-15T21:51:23.600ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61892024-11-15T21:51:23.601ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "288ed5ab-4a5b-4e3a-9f21-39e40251dfbf", "content-length": "134", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} })
61902024-11-15T21:51:23.601ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
61912024-11-15T21:51:23.601ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
61922024-11-15T21:51:23.601ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61932024-11-15T21:51:23.601ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61942024-11-15T21:51:23.601ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61952024-11-15T21:51:23.601ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61962024-11-15T21:51:23.601ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61972024-11-15T21:51:23.601ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61982024-11-15T21:51:23.601ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61992024-11-15T21:51:23.601ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62002024-11-15T21:51:23.602ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
62012024-11-15T21:51:23.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62022024-11-15T21:51:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62032024-11-15T21:51:23.604ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62042024-11-15T21:51:23.604ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aa2774e-00b1-4e21-9abf-990a1c9128ee", "content-length": "2", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} })
62052024-11-15T21:51:23.604ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62062024-11-15T21:51:23.604ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ade3beab-8901-49e4-8f31-f722fcce671c", "content-length": "52", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} })
62072024-11-15T21:51:23.604ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
62082024-11-15T21:51:23.604ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62092024-11-15T21:51:23.704ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a2e202ae-0d97-4b0a-a3c8-9b4699078592", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} })
62102024-11-15T21:51:23.704ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
62112024-11-15T21:51:23.704ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62122024-11-15T21:51:23.704ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "59da5bd8-2134-4803-ae9c-f0188c8d57c8", "content-length": "682", "date": "Fri, 15 Nov 2024 21:51:23 GMT"} })
62132024-11-15T21:51:23.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62142024-11-15T21:51:23.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62152024-11-15T21:51:23.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62162024-11-15T21:51:23.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62172024-11-15T21:51:23.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62182024-11-15T21:51:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62192024-11-15T21:51:23.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62202024-11-15T21:51:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62212024-11-15T21:51:23.721ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 688.79322ms iteration = 19 status = {}
62222024-11-15T21:51:24.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9d1af16d-1490-4bc0-80c1-348af13a7ece roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62232024-11-15T21:51:24.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9d1af16d-1490-4bc0-80c1-348af13a7ece resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62242024-11-15T21:51:24.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9d1af16d-1490-4bc0-80c1-348af13a7ece response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62252024-11-15T21:51:24.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 374fc346-eff0-4e2b-832b-6810efa73e43 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
62262024-11-15T21:51:24.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 374fc346-eff0-4e2b-832b-6810efa73e43 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
62272024-11-15T21:51:24.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 374fc346-eff0-4e2b-832b-6810efa73e43 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
62282024-11-15T21:51:25.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d7336b19-b542-4e47-ba3f-97698c25b427 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62292024-11-15T21:51:25.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d7336b19-b542-4e47-ba3f-97698c25b427 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62302024-11-15T21:51:25.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d7336b19-b542-4e47-ba3f-97698c25b427 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62312024-11-15T21:51:26.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 385d02f2-32e6-4b95-ad07-e3bf71031d94 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62322024-11-15T21:51:26.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 385d02f2-32e6-4b95-ad07-e3bf71031d94 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62332024-11-15T21:51:26.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 385d02f2-32e6-4b95-ad07-e3bf71031d94 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62342024-11-15T21:51:27.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1a61f7c6-f799-48ec-abde-f768f4ad95e0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62352024-11-15T21:51:27.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1a61f7c6-f799-48ec-abde-f768f4ad95e0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62362024-11-15T21:51:27.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1a61f7c6-f799-48ec-abde-f768f4ad95e0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62372024-11-15T21:51:28.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 19b52dfe-f88a-42a3-8102-aa48823dab6b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62382024-11-15T21:51:28.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 19b52dfe-f88a-42a3-8102-aa48823dab6b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62392024-11-15T21:51:28.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 19b52dfe-f88a-42a3-8102-aa48823dab6b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62402024-11-15T21:51:29.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3c7c679c-f42c-44f3-befb-5c9f8fe2ad81 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62412024-11-15T21:51:29.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3c7c679c-f42c-44f3-befb-5c9f8fe2ad81 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62422024-11-15T21:51:29.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3c7c679c-f42c-44f3-befb-5c9f8fe2ad81 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62432024-11-15T21:51:30.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d6a322c5-9898-4e12-872c-d931d9c3ac95 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62442024-11-15T21:51:30.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d6a322c5-9898-4e12-872c-d931d9c3ac95 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62452024-11-15T21:51:30.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d6a322c5-9898-4e12-872c-d931d9c3ac95 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62462024-11-15T21:51:30.674ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = c0b0a591-dca5-4095-8b2a-6b351e821b00 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
62472024-11-15T21:51:31.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5921d92f-8844-40a7-a4a3-fcda1098f0f7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62482024-11-15T21:51:31.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5921d92f-8844-40a7-a4a3-fcda1098f0f7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62492024-11-15T21:51:31.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5921d92f-8844-40a7-a4a3-fcda1098f0f7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62502024-11-15T21:51:32.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 21e04ba0-8dbf-45f0-9c68-3c9082aa43d7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62512024-11-15T21:51:32.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 21e04ba0-8dbf-45f0-9c68-3c9082aa43d7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62522024-11-15T21:51:32.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 21e04ba0-8dbf-45f0-9c68-3c9082aa43d7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62532024-11-15T21:51:33.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
62542024-11-15T21:51:33.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62552024-11-15T21:51:33.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
62562024-11-15T21:51:33.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62572024-11-15T21:51:33.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62582024-11-15T21:51:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62592024-11-15T21:51:33.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62602024-11-15T21:51:33.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62612024-11-15T21:51:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62622024-11-15T21:51:33.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.226578ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62632024-11-15T21:51:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62642024-11-15T21:51:33.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62652024-11-15T21:51:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62662024-11-15T21:51:33.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62672024-11-15T21:51:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62682024-11-15T21:51:33.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62692024-11-15T21:51:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
62702024-11-15T21:51:33.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62712024-11-15T21:51:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62722024-11-15T21:51:33.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
62732024-11-15T21:51:33.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.825369ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
62742024-11-15T21:51:33.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dfb88d60-9afb-445f-a7a2-dbdb78ad306d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62752024-11-15T21:51:33.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dfb88d60-9afb-445f-a7a2-dbdb78ad306d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62762024-11-15T21:51:33.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dfb88d60-9afb-445f-a7a2-dbdb78ad306d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62772024-11-15T21:51:34.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 04e2ff44-4fcc-4e60-8f30-731256c3d9ae roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62782024-11-15T21:51:34.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 04e2ff44-4fcc-4e60-8f30-731256c3d9ae resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62792024-11-15T21:51:34.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 04e2ff44-4fcc-4e60-8f30-731256c3d9ae response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62802024-11-15T21:51:35.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5054ca3c-5a3c-4ff6-a073-74be94238c62 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62812024-11-15T21:51:35.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5054ca3c-5a3c-4ff6-a073-74be94238c62 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62822024-11-15T21:51:35.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5054ca3c-5a3c-4ff6-a073-74be94238c62 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62832024-11-15T21:51:36.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 19bd9151-68af-46fe-aa3a-b64d7f82996f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62842024-11-15T21:51:36.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 19bd9151-68af-46fe-aa3a-b64d7f82996f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62852024-11-15T21:51:36.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 19bd9151-68af-46fe-aa3a-b64d7f82996f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62862024-11-15T21:51:37.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4040ca8a-2ca4-410e-9c5b-31c678ed3f74 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62872024-11-15T21:51:37.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4040ca8a-2ca4-410e-9c5b-31c678ed3f74 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62882024-11-15T21:51:37.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4040ca8a-2ca4-410e-9c5b-31c678ed3f74 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62892024-11-15T21:51:38.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d02e947d-3130-4777-97c4-20463915e360 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62902024-11-15T21:51:38.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d02e947d-3130-4777-97c4-20463915e360 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62912024-11-15T21:51:38.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d02e947d-3130-4777-97c4-20463915e360 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62922024-11-15T21:51:39.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e67073d1-63d7-4196-88a5-a6ef4989b24e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62932024-11-15T21:51:39.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e67073d1-63d7-4196-88a5-a6ef4989b24e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62942024-11-15T21:51:39.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e67073d1-63d7-4196-88a5-a6ef4989b24e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62952024-11-15T21:51:40.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = aac23597-4fa4-4461-95d2-3819e545ed2e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62962024-11-15T21:51:40.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = aac23597-4fa4-4461-95d2-3819e545ed2e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62972024-11-15T21:51:40.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = aac23597-4fa4-4461-95d2-3819e545ed2e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62982024-11-15T21:51:41.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dea34da6-a4fa-4031-be2e-dac01735696f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
62992024-11-15T21:51:41.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dea34da6-a4fa-4031-be2e-dac01735696f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63002024-11-15T21:51:41.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dea34da6-a4fa-4031-be2e-dac01735696f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63012024-11-15T21:51:42.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9a33f972-0bf7-4a5f-86ab-9bafcfc78f8c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63022024-11-15T21:51:42.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9a33f972-0bf7-4a5f-86ab-9bafcfc78f8c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63032024-11-15T21:51:42.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9a33f972-0bf7-4a5f-86ab-9bafcfc78f8c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63042024-11-15T21:51:43.030ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
63052024-11-15T21:51:43.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
63062024-11-15T21:51:43.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63072024-11-15T21:51:43.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63082024-11-15T21:51:43.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63092024-11-15T21:51:43.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63102024-11-15T21:51:43.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63112024-11-15T21:51:43.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63122024-11-15T21:51:43.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63132024-11-15T21:51:43.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.69403ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63142024-11-15T21:51:43.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63152024-11-15T21:51:43.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63162024-11-15T21:51:43.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63172024-11-15T21:51:43.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63182024-11-15T21:51:43.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63192024-11-15T21:51:43.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63202024-11-15T21:51:43.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
63212024-11-15T21:51:43.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63222024-11-15T21:51:43.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63232024-11-15T21:51:43.049ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
63242024-11-15T21:51:43.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.445716ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
63252024-11-15T21:51:43.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6530160b-6852-430e-89ad-1bcf81a17871 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63262024-11-15T21:51:43.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6530160b-6852-430e-89ad-1bcf81a17871 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63272024-11-15T21:51:43.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6530160b-6852-430e-89ad-1bcf81a17871 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63282024-11-15T21:51:44.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8179839f-d257-453a-a66e-c736818671b8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63292024-11-15T21:51:44.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8179839f-d257-453a-a66e-c736818671b8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63302024-11-15T21:51:44.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8179839f-d257-453a-a66e-c736818671b8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63312024-11-15T21:51:45.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 620672c1-cf2d-48dc-b93e-d27ed54c886b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63322024-11-15T21:51:45.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 620672c1-cf2d-48dc-b93e-d27ed54c886b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63332024-11-15T21:51:45.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 620672c1-cf2d-48dc-b93e-d27ed54c886b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63342024-11-15T21:51:45.670ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1274 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 1d4ae487-574b-4725-9115-8c347c84caaf response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
63352024-11-15T21:51:46.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1de2ded8-9ddb-469d-958f-c7835fe441ea roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63362024-11-15T21:51:46.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1de2ded8-9ddb-469d-958f-c7835fe441ea resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63372024-11-15T21:51:46.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1de2ded8-9ddb-469d-958f-c7835fe441ea response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63382024-11-15T21:51:47.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c9948ff5-44c5-4a50-8fbe-537accb83e92 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63392024-11-15T21:51:47.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c9948ff5-44c5-4a50-8fbe-537accb83e92 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63402024-11-15T21:51:47.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c9948ff5-44c5-4a50-8fbe-537accb83e92 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63412024-11-15T21:51:48.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c27caa8a-c273-49b4-ab93-daa9178555eb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63422024-11-15T21:51:48.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c27caa8a-c273-49b4-ab93-daa9178555eb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63432024-11-15T21:51:48.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c27caa8a-c273-49b4-ab93-daa9178555eb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63442024-11-15T21:51:49.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e50714e1-b2e2-48cc-a93a-b3497140d337 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63452024-11-15T21:51:49.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e50714e1-b2e2-48cc-a93a-b3497140d337 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63462024-11-15T21:51:49.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e50714e1-b2e2-48cc-a93a-b3497140d337 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63472024-11-15T21:51:50.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ad1d6b5-e403-4cfc-89f4-8d07013f9777 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63482024-11-15T21:51:50.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ad1d6b5-e403-4cfc-89f4-8d07013f9777 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63492024-11-15T21:51:50.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ad1d6b5-e403-4cfc-89f4-8d07013f9777 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63502024-11-15T21:51:50.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0ea6e0a0-5bf0-49e7-b469-e6110804804c roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
63512024-11-15T21:51:50.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0ea6e0a0-5bf0-49e7-b469-e6110804804c resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
63522024-11-15T21:51:50.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0ea6e0a0-5bf0-49e7-b469-e6110804804c response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
63532024-11-15T21:51:50.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 9a0c48c7-badb-46b7-8db2-b73f23bdd83b roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
63542024-11-15T21:51:50.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 9a0c48c7-badb-46b7-8db2-b73f23bdd83b resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
63552024-11-15T21:51:50.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 9a0c48c7-badb-46b7-8db2-b73f23bdd83b response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
63562024-11-15T21:51:51.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 72058bea-a8be-4675-9c60-97897d930f11 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63572024-11-15T21:51:51.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 72058bea-a8be-4675-9c60-97897d930f11 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63582024-11-15T21:51:51.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 72058bea-a8be-4675-9c60-97897d930f11 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63592024-11-15T21:51:52.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 317cff0e-f1c4-4606-88e1-1ddf3c9388d1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63602024-11-15T21:51:52.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 317cff0e-f1c4-4606-88e1-1ddf3c9388d1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63612024-11-15T21:51:52.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 317cff0e-f1c4-4606-88e1-1ddf3c9388d1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
63622024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
63632024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
63642024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
63652024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
63662024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63672024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
63682024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63692024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
63702024-11-15T21:51:53.029ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
63712024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
63722024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63732024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63742024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
63752024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63762024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
63772024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63782024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
63792024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
63802024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63812024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
63822024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63832024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
63842024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63852024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
63862024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
63872024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
63882024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
63892024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63902024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
63912024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63922024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63932024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
63942024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
63952024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
63962024-11-15T21:51:53.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63972024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63982024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63992024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64002024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64012024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64022024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64032024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64042024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64052024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64062024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64072024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64082024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64092024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64102024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64112024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64122024-11-15T21:51:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64132024-11-15T21:51:53.033ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1594, tv_nsec: 976464807 } })
64142024-11-15T21:51:53.033ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
64152024-11-15T21:51:53.034ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.430456ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64162024-11-15T21:51:53.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64172024-11-15T21:51:53.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64182024-11-15T21:51:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64192024-11-15T21:51:53.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64202024-11-15T21:51:53.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64212024-11-15T21:51:53.036ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1594, tv_nsec: 980026970 } })
64222024-11-15T21:51:53.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
64232024-11-15T21:51:53.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64242024-11-15T21:51:53.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64252024-11-15T21:51:53.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64262024-11-15T21:51:53.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64272024-11-15T21:51:53.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64282024-11-15T21:51:53.042ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64292024-11-15T21:51:53.042ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
64302024-11-15T21:51:53.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64312024-11-15T21:51:53.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64322024-11-15T21:51:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64332024-11-15T21:51:53.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64342024-11-15T21:51:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64352024-11-15T21:51:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
64362024-11-15T21:51:53.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64372024-11-15T21:51:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64382024-11-15T21:51:53.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64392024-11-15T21:51:53.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64402024-11-15T21:51:53.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64412024-11-15T21:51:53.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64422024-11-15T21:51:53.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64432024-11-15T21:51:53.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64442024-11-15T21:51:53.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64452024-11-15T21:51:53.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64462024-11-15T21:51:53.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64472024-11-15T21:51:53.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64482024-11-15T21:51:53.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64492024-11-15T21:51:53.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64502024-11-15T21:51:53.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64512024-11-15T21:51:53.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64522024-11-15T21:51:53.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64532024-11-15T21:51:53.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64542024-11-15T21:51:53.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64552024-11-15T21:51:53.053ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64562024-11-15T21:51:53.053ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64572024-11-15T21:51:53.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64582024-11-15T21:51:53.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64592024-11-15T21:51:53.054ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64602024-11-15T21:51:53.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64612024-11-15T21:51:53.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64622024-11-15T21:51:53.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64632024-11-15T21:51:53.055ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1594, tv_nsec: 998266038 } })
64642024-11-15T21:51:53.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64652024-11-15T21:51:53.055ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
64662024-11-15T21:51:53.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64672024-11-15T21:51:53.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64682024-11-15T21:51:53.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64692024-11-15T21:51:53.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64702024-11-15T21:51:53.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64712024-11-15T21:51:53.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
64722024-11-15T21:51:53.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64732024-11-15T21:51:53.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64742024-11-15T21:51:53.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64752024-11-15T21:51:53.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64762024-11-15T21:51:53.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.786042ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
64772024-11-15T21:51:53.075ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64782024-11-15T21:51:53.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.133859ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64792024-11-15T21:51:53.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64802024-11-15T21:51:53.077ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 48.208673ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64812024-11-15T21:51:53.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
64822024-11-15T21:51:53.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.044325ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
64832024-11-15T21:51:53.080ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.88048ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
64842024-11-15T21:51:53.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64852024-11-15T21:51:53.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64862024-11-15T21:51:53.081ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64872024-11-15T21:51:53.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64882024-11-15T21:51:53.081ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64892024-11-15T21:51:53.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64902024-11-15T21:51:53.082ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64912024-11-15T21:51:53.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64922024-11-15T21:51:53.083ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
64932024-11-15T21:51:53.083ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64942024-11-15T21:51:53.084ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3050ea5-19d0-4647-9539-2a29811f7a16", "content-length": "26", "date": "Fri, 15 Nov 2024 21:51:52 GMT"} })
64952024-11-15T21:51:53.084ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64962024-11-15T21:51:53.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64972024-11-15T21:51:53.085ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
64982024-11-15T21:51:53.085ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64992024-11-15T21:51:53.085ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65002024-11-15T21:51:53.086ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d56312d1-30dc-40c8-98a8-96ca78103853", "content-length": "26", "date": "Fri, 15 Nov 2024 21:51:52 GMT"} })
65012024-11-15T21:51:53.086ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65022024-11-15T21:51:53.088ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65032024-11-15T21:51:53.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
65042024-11-15T21:51:53.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65052024-11-15T21:51:53.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65062024-11-15T21:51:53.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65072024-11-15T21:51:53.093ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.696124ms iteration = 20 status = 0
65082024-11-15T21:51:53.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65092024-11-15T21:51:53.095ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65102024-11-15T21:51:53.095ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.620196ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65112024-11-15T21:51:53.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65122024-11-15T21:51:53.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65132024-11-15T21:51:53.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65142024-11-15T21:51:53.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65152024-11-15T21:51:53.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65162024-11-15T21:51:53.103ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65172024-11-15T21:51:53.103ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
65182024-11-15T21:51:53.103ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 73.98947ms iteration = 23 status = {"physical_disks_added":0}
65192024-11-15T21:51:53.103ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 73.90006ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
65202024-11-15T21:51:53.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65212024-11-15T21:51:53.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65222024-11-15T21:51:53.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65232024-11-15T21:51:53.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.796061ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65242024-11-15T21:51:53.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.33947ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
65252024-11-15T21:51:53.196ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
65262024-11-15T21:51:53.196ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65272024-11-15T21:51:53.196ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86a52848-dfd2-4471-9e91-9c5baf5d9a09", "content-length": "26", "date": "Fri, 15 Nov 2024 21:51:52 GMT"} })
65282024-11-15T21:51:53.196ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65292024-11-15T21:51:53.198ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
65302024-11-15T21:51:53.220ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65312024-11-15T21:51:53.221ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d4d34a0-cf38-482d-8fce-d8d5756d93fb", "content-length": "1", "date": "Fri, 15 Nov 2024 21:51:52 GMT"} })
65322024-11-15T21:51:53.221ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 191.798345ms iteration = 20 status = {}
65332024-11-15T21:51:53.223ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65342024-11-15T21:51:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65352024-11-15T21:51:53.255ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
65362024-11-15T21:51:53.255ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65372024-11-15T21:51:53.256ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0126b975-ccbd-4d66-af38-66e4178ac4a2", "content-length": "372", "date": "Fri, 15 Nov 2024 21:51:53 GMT"} })
65382024-11-15T21:51:53.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65392024-11-15T21:51:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65402024-11-15T21:51:53.257ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 227.851379ms iteration = 20 status = null
65412024-11-15T21:51:53.260ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65422024-11-15T21:51:53.260ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe0de066-1fe6-402c-8a77-94bf54eaa00f", "content-length": "691", "date": "Fri, 15 Nov 2024 21:51:53 GMT"} })
65432024-11-15T21:51:53.260ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
65442024-11-15T21:51:53.260ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
65452024-11-15T21:51:53.260ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
65462024-11-15T21:51:53.262ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 233.022112ms iteration = 20 status = {}
65472024-11-15T21:51:53.271ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
65482024-11-15T21:51:53.271ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
65492024-11-15T21:51:53.272ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fa159b7b-c79d-4b38-a755-5b84cddc26d2", "date": "Fri, 15 Nov 2024 21:51:53 GMT"} })
65502024-11-15T21:51:53.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65512024-11-15T21:51:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65522024-11-15T21:51:53.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65532024-11-15T21:51:53.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65542024-11-15T21:51:53.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65552024-11-15T21:51:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65562024-11-15T21:51:53.280ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65572024-11-15T21:51:53.280ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65582024-11-15T21:51:53.284ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e1a5c84c-9345-4942-bb13-cbbaf7bc6745", "date": "Fri, 15 Nov 2024 21:51:53 GMT"} })
65592024-11-15T21:51:53.286ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 257.000718ms iteration = 21 status = {}
65602024-11-15T21:51:53.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65612024-11-15T21:51:53.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65622024-11-15T21:51:53.333ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
65632024-11-15T21:51:53.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65642024-11-15T21:51:53.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65652024-11-15T21:51:53.340ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65662024-11-15T21:51:53.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "03d71e7f-8281-4a3c-8546-784297aae8f1", "content-length": "134", "date": "Fri, 15 Nov 2024 21:51:52 GMT"} })
65672024-11-15T21:51:53.340ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65682024-11-15T21:51:53.340ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
65692024-11-15T21:51:53.340ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65702024-11-15T21:51:53.340ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65712024-11-15T21:51:53.340ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65722024-11-15T21:51:53.340ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65732024-11-15T21:51:53.340ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65742024-11-15T21:51:53.340ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65752024-11-15T21:51:53.340ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65762024-11-15T21:51:53.340ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65772024-11-15T21:51:53.341ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
65782024-11-15T21:51:53.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65792024-11-15T21:51:53.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65802024-11-15T21:51:53.342ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65812024-11-15T21:51:53.342ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8093087a-ad7b-497b-b790-02cc955323fa", "content-length": "2", "date": "Fri, 15 Nov 2024 21:51:52 GMT"} })
65822024-11-15T21:51:53.342ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65832024-11-15T21:51:53.342ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c80cd85-becd-4268-b39c-6345aca96ecc", "content-length": "52", "date": "Fri, 15 Nov 2024 21:51:52 GMT"} })
65842024-11-15T21:51:53.342ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
65852024-11-15T21:51:53.342ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65862024-11-15T21:51:53.435ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7fc2ddaf-f760-468c-94a2-96b76e107d97", "date": "Fri, 15 Nov 2024 21:51:52 GMT"} })
65872024-11-15T21:51:53.435ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
65882024-11-15T21:51:53.435ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65892024-11-15T21:51:53.436ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5c7973d-fc62-48cd-a96f-e80720dd94e5", "content-length": "682", "date": "Fri, 15 Nov 2024 21:51:52 GMT"} })
65902024-11-15T21:51:53.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65912024-11-15T21:51:53.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65922024-11-15T21:51:53.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65932024-11-15T21:51:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65942024-11-15T21:51:53.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65952024-11-15T21:51:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65962024-11-15T21:51:53.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65972024-11-15T21:51:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65982024-11-15T21:51:53.453ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 423.829911ms iteration = 20 status = {}
65992024-11-15T21:51:53.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4862c1cd-871a-4ae3-a58f-171fb30a6f26 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66002024-11-15T21:51:53.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4862c1cd-871a-4ae3-a58f-171fb30a6f26 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66012024-11-15T21:51:53.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4862c1cd-871a-4ae3-a58f-171fb30a6f26 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66022024-11-15T21:51:54.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = fabf5d49-6962-4008-86fd-000b51bbd315 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
66032024-11-15T21:51:54.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = fabf5d49-6962-4008-86fd-000b51bbd315 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
66042024-11-15T21:51:54.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = fabf5d49-6962-4008-86fd-000b51bbd315 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
66052024-11-15T21:51:54.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 39a1aed2-c099-4097-a430-3693cd6f6f86 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66062024-11-15T21:51:54.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 39a1aed2-c099-4097-a430-3693cd6f6f86 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66072024-11-15T21:51:54.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 39a1aed2-c099-4097-a430-3693cd6f6f86 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66082024-11-15T21:51:55.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 335c6cb7-93b1-430a-93dc-e1cdb19b90f3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66092024-11-15T21:51:55.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 335c6cb7-93b1-430a-93dc-e1cdb19b90f3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66102024-11-15T21:51:55.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 335c6cb7-93b1-430a-93dc-e1cdb19b90f3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66112024-11-15T21:51:56.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 534eb6c3-9478-49ca-868c-9845e4d1f02e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66122024-11-15T21:51:56.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 534eb6c3-9478-49ca-868c-9845e4d1f02e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66132024-11-15T21:51:56.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 534eb6c3-9478-49ca-868c-9845e4d1f02e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66142024-11-15T21:51:57.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2a482b77-3f0f-4d79-bc6c-bd6e80900689 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66152024-11-15T21:51:57.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2a482b77-3f0f-4d79-bc6c-bd6e80900689 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66162024-11-15T21:51:57.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2a482b77-3f0f-4d79-bc6c-bd6e80900689 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66172024-11-15T21:51:58.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 301ff090-cef7-409e-a4d8-9a90274a8289 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66182024-11-15T21:51:58.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 301ff090-cef7-409e-a4d8-9a90274a8289 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66192024-11-15T21:51:58.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 301ff090-cef7-409e-a4d8-9a90274a8289 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66202024-11-15T21:51:59.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 15b31987-b6fd-4806-b817-77a2b04c865f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66212024-11-15T21:51:59.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 15b31987-b6fd-4806-b817-77a2b04c865f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66222024-11-15T21:51:59.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 15b31987-b6fd-4806-b817-77a2b04c865f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66232024-11-15T21:52:00.671ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1862 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = d1cacdcd-669c-4696-8bbe-440f66538632 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
66242024-11-15T21:52:00.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9fbaaea7-ed61-404b-81cd-2a214c563c12 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66252024-11-15T21:52:00.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9fbaaea7-ed61-404b-81cd-2a214c563c12 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66262024-11-15T21:52:00.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9fbaaea7-ed61-404b-81cd-2a214c563c12 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66272024-11-15T21:52:01.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a0b45364-b8bd-40d5-aea2-040c54c02296 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66282024-11-15T21:52:01.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a0b45364-b8bd-40d5-aea2-040c54c02296 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66292024-11-15T21:52:01.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a0b45364-b8bd-40d5-aea2-040c54c02296 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66302024-11-15T21:52:02.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f5c823a7-6628-4ceb-853c-0c1b499e0740 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66312024-11-15T21:52:02.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f5c823a7-6628-4ceb-853c-0c1b499e0740 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66322024-11-15T21:52:02.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f5c823a7-6628-4ceb-853c-0c1b499e0740 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66332024-11-15T21:52:03.030ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
66342024-11-15T21:52:03.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
66352024-11-15T21:52:03.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66362024-11-15T21:52:03.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66372024-11-15T21:52:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66382024-11-15T21:52:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66392024-11-15T21:52:03.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66402024-11-15T21:52:03.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66412024-11-15T21:52:03.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66422024-11-15T21:52:03.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.929195ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66432024-11-15T21:52:03.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66442024-11-15T21:52:03.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66452024-11-15T21:52:03.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66462024-11-15T21:52:03.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66472024-11-15T21:52:03.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66482024-11-15T21:52:03.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66492024-11-15T21:52:03.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
66502024-11-15T21:52:03.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66512024-11-15T21:52:03.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66522024-11-15T21:52:03.049ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
66532024-11-15T21:52:03.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.256275ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
66542024-11-15T21:52:03.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f143c109-cd2e-401e-b4b5-f90e2715f522 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66552024-11-15T21:52:03.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f143c109-cd2e-401e-b4b5-f90e2715f522 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66562024-11-15T21:52:03.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f143c109-cd2e-401e-b4b5-f90e2715f522 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66572024-11-15T21:52:04.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 24e91977-6523-455e-a8b9-9badbb2ce2db roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66582024-11-15T21:52:04.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 24e91977-6523-455e-a8b9-9badbb2ce2db resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66592024-11-15T21:52:04.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 24e91977-6523-455e-a8b9-9badbb2ce2db response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66602024-11-15T21:52:05.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14584883-0a22-440f-9f54-40182d9d6b48 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66612024-11-15T21:52:05.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14584883-0a22-440f-9f54-40182d9d6b48 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66622024-11-15T21:52:05.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14584883-0a22-440f-9f54-40182d9d6b48 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66632024-11-15T21:52:06.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = aef72975-0352-41a6-82a3-603fd56966cf roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66642024-11-15T21:52:06.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = aef72975-0352-41a6-82a3-603fd56966cf resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66652024-11-15T21:52:06.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = aef72975-0352-41a6-82a3-603fd56966cf response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66662024-11-15T21:52:08.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d19121fc-b7bc-4716-a75c-0fb8bdfbc958 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66672024-11-15T21:52:08.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d19121fc-b7bc-4716-a75c-0fb8bdfbc958 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66682024-11-15T21:52:08.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d19121fc-b7bc-4716-a75c-0fb8bdfbc958 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66692024-11-15T21:52:09.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 25ec2949-9363-4ce5-ae45-590cad2f39b8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66702024-11-15T21:52:09.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 25ec2949-9363-4ce5-ae45-590cad2f39b8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66712024-11-15T21:52:09.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 25ec2949-9363-4ce5-ae45-590cad2f39b8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66722024-11-15T21:52:10.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 154168a3-002c-4cab-a9e5-150adc253b06 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66732024-11-15T21:52:10.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 154168a3-002c-4cab-a9e5-150adc253b06 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66742024-11-15T21:52:10.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 154168a3-002c-4cab-a9e5-150adc253b06 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66752024-11-15T21:52:11.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 06ec56ef-6a32-4a62-ad27-fcace8865b36 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66762024-11-15T21:52:11.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 06ec56ef-6a32-4a62-ad27-fcace8865b36 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66772024-11-15T21:52:11.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 06ec56ef-6a32-4a62-ad27-fcace8865b36 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66782024-11-15T21:52:12.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ecf7834c-1b38-4f48-aa28-45f6d17c6d1b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66792024-11-15T21:52:12.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ecf7834c-1b38-4f48-aa28-45f6d17c6d1b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66802024-11-15T21:52:12.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ecf7834c-1b38-4f48-aa28-45f6d17c6d1b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
66812024-11-15T21:52:13.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
66822024-11-15T21:52:13.030ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
66832024-11-15T21:52:13.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66842024-11-15T21:52:13.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66852024-11-15T21:52:13.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66862024-11-15T21:52:13.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66872024-11-15T21:52:13.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66882024-11-15T21:52:13.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66892024-11-15T21:52:13.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66902024-11-15T21:52:13.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.133937ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66912024-11-15T21:52:13.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66922024-11-15T21:52:13.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66932024-11-15T21:52:13.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66942024-11-15T21:52:13.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66952024-11-15T21:52:13.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66962024-11-15T21:52:13.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66972024-11-15T21:52:13.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
66982024-11-15T21:52:13.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66992024-11-15T21:52:13.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67002024-11-15T21:52:13.049ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
67012024-11-15T21:52:13.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.696461ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
67022024-11-15T21:52:13.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6aa7d24-4208-4e45-9bd2-299f1686a11f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67032024-11-15T21:52:13.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6aa7d24-4208-4e45-9bd2-299f1686a11f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67042024-11-15T21:52:13.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6aa7d24-4208-4e45-9bd2-299f1686a11f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67052024-11-15T21:52:14.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a75739b2-e9b8-41ef-aec3-f0d702c34333 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67062024-11-15T21:52:14.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a75739b2-e9b8-41ef-aec3-f0d702c34333 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67072024-11-15T21:52:14.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a75739b2-e9b8-41ef-aec3-f0d702c34333 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67082024-11-15T21:52:15.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9040567d-c610-4729-a605-b6825d0365b6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67092024-11-15T21:52:15.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9040567d-c610-4729-a605-b6825d0365b6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67102024-11-15T21:52:15.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9040567d-c610-4729-a605-b6825d0365b6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67112024-11-15T21:52:15.671ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1597 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 96819544-cc0c-4a31-8ee1-fd878f51d6b2 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
67122024-11-15T21:52:16.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8f0f7197-538e-469a-88ee-4d871e4aecd3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67132024-11-15T21:52:16.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8f0f7197-538e-469a-88ee-4d871e4aecd3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67142024-11-15T21:52:16.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8f0f7197-538e-469a-88ee-4d871e4aecd3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67152024-11-15T21:52:17.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4972d50f-3837-48eb-9167-baf16a0d1a45 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67162024-11-15T21:52:17.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4972d50f-3837-48eb-9167-baf16a0d1a45 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67172024-11-15T21:52:17.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4972d50f-3837-48eb-9167-baf16a0d1a45 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67182024-11-15T21:52:18.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a3deb5da-1573-4168-b963-55371dfd2ba6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67192024-11-15T21:52:18.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a3deb5da-1573-4168-b963-55371dfd2ba6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67202024-11-15T21:52:18.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a3deb5da-1573-4168-b963-55371dfd2ba6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67212024-11-15T21:52:19.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f13626ff-9111-4e2c-844b-577350164c7a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67222024-11-15T21:52:19.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f13626ff-9111-4e2c-844b-577350164c7a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67232024-11-15T21:52:19.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f13626ff-9111-4e2c-844b-577350164c7a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67242024-11-15T21:52:20.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5fe18a0c-5c1c-4e51-8010-0d55cb98602d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67252024-11-15T21:52:20.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5fe18a0c-5c1c-4e51-8010-0d55cb98602d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67262024-11-15T21:52:20.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5fe18a0c-5c1c-4e51-8010-0d55cb98602d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67272024-11-15T21:52:20.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 43e47816-9601-4e1c-81c3-d2e7b5ad3470 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
67282024-11-15T21:52:20.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 43e47816-9601-4e1c-81c3-d2e7b5ad3470 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
67292024-11-15T21:52:20.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 43e47816-9601-4e1c-81c3-d2e7b5ad3470 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
67302024-11-15T21:52:20.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = b3cff6e1-4021-47ab-bf80-ed345105ef57 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
67312024-11-15T21:52:20.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = b3cff6e1-4021-47ab-bf80-ed345105ef57 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
67322024-11-15T21:52:20.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = b3cff6e1-4021-47ab-bf80-ed345105ef57 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
67332024-11-15T21:52:21.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ffa0b48-d9c0-4278-86db-92d73f0d56c5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67342024-11-15T21:52:21.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ffa0b48-d9c0-4278-86db-92d73f0d56c5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67352024-11-15T21:52:21.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ffa0b48-d9c0-4278-86db-92d73f0d56c5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67362024-11-15T21:52:22.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 07a29a5e-3b3b-4b05-adf9-97a6a85add86 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67372024-11-15T21:52:22.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 07a29a5e-3b3b-4b05-adf9-97a6a85add86 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67382024-11-15T21:52:22.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 07a29a5e-3b3b-4b05-adf9-97a6a85add86 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
67392024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
67402024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
67412024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
67422024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
67432024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
67442024-11-15T21:52:23.030ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
67452024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67462024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67472024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67482024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
67492024-11-15T21:52:23.030ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
67502024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
67512024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.85\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
67522024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
67532024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
67542024-11-15T21:52:23.030ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:42:23.030381970 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
67552024-11-15T21:52:23.030ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
67562024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
67572024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
67582024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67592024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67602024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
67612024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67622024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
67632024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
67642024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
67652024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67662024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67672024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
67682024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67692024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
67702024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
67712024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67722024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
67732024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67742024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
67752024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67762024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
67772024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67782024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
67792024-11-15T21:52:23.030ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67802024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67812024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
67822024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67832024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
67842024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67852024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
67862024-11-15T21:52:23.030ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
67872024-11-15T21:52:23.030ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
67882024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
67892024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67902024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
67912024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67922024-11-15T21:52:23.030ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67932024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67942024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67952024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
67962024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
67972024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
67982024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
67992024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68002024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68012024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68022024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68032024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68042024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
68052024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68062024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68072024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68082024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
68092024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
68102024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
68112024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
68122024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
68132024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68142024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68152024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68162024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68172024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
68182024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
68192024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68202024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68212024-11-15T21:52:23.031ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
68222024-11-15T21:52:23.031ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1624, tv_nsec: 973914178 } })
68232024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68242024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68252024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68262024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68272024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68282024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68292024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68302024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
68312024-11-15T21:52:23.031ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1624, tv_nsec: 974088679 } })
68322024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68332024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
68342024-11-15T21:52:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68352024-11-15T21:52:23.032ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
68362024-11-15T21:52:23.032ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.504059ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
68372024-11-15T21:52:23.032ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
68382024-11-15T21:52:23.032ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.960922ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
68392024-11-15T21:52:23.037ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.178507ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
68402024-11-15T21:52:23.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68412024-11-15T21:52:23.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68422024-11-15T21:52:23.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68432024-11-15T21:52:23.040ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68442024-11-15T21:52:23.041ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:42:23.030381970 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
68452024-11-15T21:52:23.041ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.995052ms iteration = 11 status = {"expiration":"2024-11-15T21:42:23.030381970Z","pruned":[]}
68462024-11-15T21:52:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68472024-11-15T21:52:23.042ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68482024-11-15T21:52:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68492024-11-15T21:52:23.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
68502024-11-15T21:52:23.043ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68512024-11-15T21:52:23.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68522024-11-15T21:52:23.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68532024-11-15T21:52:23.045ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1624, tv_nsec: 988052959 } })
68542024-11-15T21:52:23.045ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
68552024-11-15T21:52:23.046ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.620732ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
68562024-11-15T21:52:23.047ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1624, tv_nsec: 989725670 } })
68572024-11-15T21:52:23.047ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
68582024-11-15T21:52:23.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68592024-11-15T21:52:23.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68602024-11-15T21:52:23.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68612024-11-15T21:52:23.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68622024-11-15T21:52:23.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68632024-11-15T21:52:23.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68642024-11-15T21:52:23.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68652024-11-15T21:52:23.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68662024-11-15T21:52:23.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68672024-11-15T21:52:23.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68682024-11-15T21:52:23.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68692024-11-15T21:52:23.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68702024-11-15T21:52:23.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68712024-11-15T21:52:23.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68722024-11-15T21:52:23.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68732024-11-15T21:52:23.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68742024-11-15T21:52:23.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68752024-11-15T21:52:23.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68762024-11-15T21:52:23.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68772024-11-15T21:52:23.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68782024-11-15T21:52:23.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68792024-11-15T21:52:23.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68802024-11-15T21:52:23.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
68812024-11-15T21:52:23.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68822024-11-15T21:52:23.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68832024-11-15T21:52:23.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68842024-11-15T21:52:23.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68852024-11-15T21:52:23.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68862024-11-15T21:52:23.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68872024-11-15T21:52:23.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68882024-11-15T21:52:23.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68892024-11-15T21:52:23.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68902024-11-15T21:52:23.066ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68912024-11-15T21:52:23.066ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
68922024-11-15T21:52:23.067ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 36.582417ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68932024-11-15T21:52:23.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68942024-11-15T21:52:23.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68952024-11-15T21:52:23.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68962024-11-15T21:52:23.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68972024-11-15T21:52:23.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68982024-11-15T21:52:23.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68992024-11-15T21:52:23.073ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 15777070 } })
69002024-11-15T21:52:23.073ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
69012024-11-15T21:52:23.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69022024-11-15T21:52:23.084ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
69032024-11-15T21:52:23.084ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
69042024-11-15T21:52:23.084ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
69052024-11-15T21:52:23.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69062024-11-15T21:52:23.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69072024-11-15T21:52:23.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69082024-11-15T21:52:23.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69092024-11-15T21:52:23.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69102024-11-15T21:52:23.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69112024-11-15T21:52:23.088ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69122024-11-15T21:52:23.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69132024-11-15T21:52:23.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69142024-11-15T21:52:23.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69152024-11-15T21:52:23.092ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69162024-11-15T21:52:23.092ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69172024-11-15T21:52:23.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69182024-11-15T21:52:23.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
69192024-11-15T21:52:23.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69202024-11-15T21:52:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69212024-11-15T21:52:23.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69222024-11-15T21:52:23.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.436181ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
69232024-11-15T21:52:23.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69242024-11-15T21:52:23.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69252024-11-15T21:52:23.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69262024-11-15T21:52:23.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69272024-11-15T21:52:23.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69282024-11-15T21:52:23.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69292024-11-15T21:52:23.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69302024-11-15T21:52:23.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69312024-11-15T21:52:23.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69322024-11-15T21:52:23.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69332024-11-15T21:52:23.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69342024-11-15T21:52:23.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69352024-11-15T21:52:23.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69362024-11-15T21:52:23.107ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69372024-11-15T21:52:23.108ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
69382024-11-15T21:52:23.108ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
69392024-11-15T21:52:23.108ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.02695ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
69402024-11-15T21:52:23.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69412024-11-15T21:52:23.109ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69422024-11-15T21:52:23.109ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
69432024-11-15T21:52:23.109ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
69442024-11-15T21:52:23.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69452024-11-15T21:52:23.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 78.647881ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
69462024-11-15T21:52:23.109ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
69472024-11-15T21:52:23.109ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = ee9ae48d-58cb-4694-b00c-e1d0e406da85
69482024-11-15T21:52:23.109ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 916db8ee-c6ee-47af-b820-c701a96c865d
69492024-11-15T21:52:23.110ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 79.592316ms iteration = 24 status = {"physical_disks_added":0}
69502024-11-15T21:52:23.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69512024-11-15T21:52:23.110ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69522024-11-15T21:52:23.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69532024-11-15T21:52:23.110ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69542024-11-15T21:52:23.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69552024-11-15T21:52:23.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69562024-11-15T21:52:23.113ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = f2fba674-2f6b-4e1d-98fd-04fc085b121a
69572024-11-15T21:52:23.113ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 916db8ee-c6ee-47af-b820-c701a96c865d
69582024-11-15T21:52:23.113ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = ee9ae48d-58cb-4694-b00c-e1d0e406da85
69592024-11-15T21:52:23.113ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = f2fba674-2f6b-4e1d-98fd-04fc085b121a
69602024-11-15T21:52:23.113ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 83.08436ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
69612024-11-15T21:52:23.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
69622024-11-15T21:52:23.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69632024-11-15T21:52:23.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69642024-11-15T21:52:23.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69652024-11-15T21:52:23.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69662024-11-15T21:52:23.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.509795ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
69672024-11-15T21:52:23.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69682024-11-15T21:52:23.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.416011ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69692024-11-15T21:52:23.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.548162ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
69702024-11-15T21:52:23.119ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
69712024-11-15T21:52:23.119ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.884136ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
69722024-11-15T21:52:23.119ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69732024-11-15T21:52:23.119ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
69742024-11-15T21:52:23.119ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69752024-11-15T21:52:23.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69762024-11-15T21:52:23.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69772024-11-15T21:52:23.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69782024-11-15T21:52:23.120ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69792024-11-15T21:52:23.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69802024-11-15T21:52:23.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69812024-11-15T21:52:23.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69822024-11-15T21:52:23.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69832024-11-15T21:52:23.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69842024-11-15T21:52:23.124ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69852024-11-15T21:52:23.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69862024-11-15T21:52:23.124ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
69872024-11-15T21:52:23.124ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
69882024-11-15T21:52:23.125ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
69892024-11-15T21:52:23.125ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 93.97155ms iteration = 12 status = {"generation":1}
69902024-11-15T21:52:23.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69912024-11-15T21:52:23.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69922024-11-15T21:52:23.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69932024-11-15T21:52:23.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69942024-11-15T21:52:23.126ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69952024-11-15T21:52:23.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69962024-11-15T21:52:23.127ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69972024-11-15T21:52:23.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69982024-11-15T21:52:23.129ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69992024-11-15T21:52:23.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70002024-11-15T21:52:23.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70012024-11-15T21:52:23.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
70022024-11-15T21:52:23.131ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70032024-11-15T21:52:23.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70042024-11-15T21:52:23.132ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70052024-11-15T21:52:23.133ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.29369ms iteration = 21 status = 0
70062024-11-15T21:52:23.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.038476ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70072024-11-15T21:52:23.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
70082024-11-15T21:52:23.135ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70092024-11-15T21:52:23.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70102024-11-15T21:52:23.138ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70112024-11-15T21:52:23.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70122024-11-15T21:52:23.141ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70132024-11-15T21:52:23.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70142024-11-15T21:52:23.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70152024-11-15T21:52:23.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70162024-11-15T21:52:23.144ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70172024-11-15T21:52:23.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70182024-11-15T21:52:23.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70192024-11-15T21:52:23.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70202024-11-15T21:52:23.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70212024-11-15T21:52:23.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70222024-11-15T21:52:23.147ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
70232024-11-15T21:52:23.147ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 116.807088ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
70242024-11-15T21:52:23.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70252024-11-15T21:52:23.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70262024-11-15T21:52:23.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70272024-11-15T21:52:23.153ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70282024-11-15T21:52:23.153ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 122.792127ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70292024-11-15T21:52:23.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
70302024-11-15T21:52:23.154ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70312024-11-15T21:52:23.154ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70322024-11-15T21:52:23.154ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70332024-11-15T21:52:23.154ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70342024-11-15T21:52:23.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70352024-11-15T21:52:23.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70362024-11-15T21:52:23.156ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70372024-11-15T21:52:23.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70382024-11-15T21:52:23.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70392024-11-15T21:52:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70402024-11-15T21:52:23.158ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
70412024-11-15T21:52:23.158ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
70422024-11-15T21:52:23.158ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
70432024-11-15T21:52:23.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70442024-11-15T21:52:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70452024-11-15T21:52:23.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70462024-11-15T21:52:23.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70472024-11-15T21:52:23.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70482024-11-15T21:52:23.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70492024-11-15T21:52:23.163ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70502024-11-15T21:52:23.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70512024-11-15T21:52:23.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70522024-11-15T21:52:23.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70532024-11-15T21:52:23.170ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
70542024-11-15T21:52:23.170ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
70552024-11-15T21:52:23.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70562024-11-15T21:52:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70572024-11-15T21:52:23.170ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70582024-11-15T21:52:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70592024-11-15T21:52:23.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70602024-11-15T21:52:23.172ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
70612024-11-15T21:52:23.172ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 142.101172ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
70622024-11-15T21:52:23.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70632024-11-15T21:52:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70642024-11-15T21:52:23.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70652024-11-15T21:52:23.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70662024-11-15T21:52:23.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70672024-11-15T21:52:23.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70682024-11-15T21:52:23.177ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
70692024-11-15T21:52:23.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
70702024-11-15T21:52:23.179ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70712024-11-15T21:52:23.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70722024-11-15T21:52:23.181ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
70732024-11-15T21:52:23.181ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
70742024-11-15T21:52:23.181ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
70752024-11-15T21:52:23.181ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 150.149615ms iteration = 12 status = {"generation":2}
70762024-11-15T21:52:23.181ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70772024-11-15T21:52:23.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70782024-11-15T21:52:23.182ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
70792024-11-15T21:52:23.183ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70802024-11-15T21:52:23.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70812024-11-15T21:52:23.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70822024-11-15T21:52:23.188ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
70832024-11-15T21:52:23.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70842024-11-15T21:52:23.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70852024-11-15T21:52:23.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70862024-11-15T21:52:23.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70872024-11-15T21:52:23.201ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70882024-11-15T21:52:23.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70892024-11-15T21:52:23.201ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70902024-11-15T21:52:23.201ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70912024-11-15T21:52:23.201ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.948429ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70922024-11-15T21:52:23.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70932024-11-15T21:52:23.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70942024-11-15T21:52:23.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70952024-11-15T21:52:23.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70962024-11-15T21:52:23.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70972024-11-15T21:52:23.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70982024-11-15T21:52:23.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70992024-11-15T21:52:23.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71002024-11-15T21:52:23.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71012024-11-15T21:52:23.210ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71022024-11-15T21:52:23.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71032024-11-15T21:52:23.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71042024-11-15T21:52:23.211ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71052024-11-15T21:52:23.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71062024-11-15T21:52:23.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71072024-11-15T21:52:23.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71082024-11-15T21:52:23.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71092024-11-15T21:52:23.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71102024-11-15T21:52:23.215ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71112024-11-15T21:52:23.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71122024-11-15T21:52:23.215ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
71132024-11-15T21:52:23.215ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71142024-11-15T21:52:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71152024-11-15T21:52:23.215ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f7144e1-dad0-4600-9043-a380c8e87c61", "content-length": "26", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
71162024-11-15T21:52:23.215ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71172024-11-15T21:52:23.217ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71182024-11-15T21:52:23.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
71192024-11-15T21:52:23.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71202024-11-15T21:52:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71212024-11-15T21:52:23.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71222024-11-15T21:52:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71232024-11-15T21:52:23.221ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71242024-11-15T21:52:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71252024-11-15T21:52:23.222ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
71262024-11-15T21:52:23.222ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71272024-11-15T21:52:23.222ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c61935a-a5d0-414b-b152-049615da75a5", "content-length": "26", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
71282024-11-15T21:52:23.222ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71292024-11-15T21:52:23.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71302024-11-15T21:52:23.224ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71312024-11-15T21:52:23.226ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
71322024-11-15T21:52:23.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71332024-11-15T21:52:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71342024-11-15T21:52:23.254ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
71352024-11-15T21:52:23.254ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71362024-11-15T21:52:23.254ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97a24d02-2201-4798-b0d4-30ef41a3427d", "content-length": "26", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
71372024-11-15T21:52:23.255ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71382024-11-15T21:52:23.256ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
71392024-11-15T21:52:23.261ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71402024-11-15T21:52:23.261ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71412024-11-15T21:52:23.261ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "82ca7b5d-612a-498a-a7f4-d181051a06ea", "content-length": "372", "date": "Fri, 15 Nov 2024 21:52:22 GMT"} })
71422024-11-15T21:52:23.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71432024-11-15T21:52:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71442024-11-15T21:52:23.336ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71452024-11-15T21:52:23.337ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "99769f3c-b25b-471a-817d-a7c15169537c", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71462024-11-15T21:52:23.337ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71472024-11-15T21:52:23.338ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3ce2cfbb-e8da-4151-81c3-99dff210f697", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71482024-11-15T21:52:23.338ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71492024-11-15T21:52:23.339ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71502024-11-15T21:52:23.339ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 309.589629ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
71512024-11-15T21:52:23.358ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
71522024-11-15T21:52:23.363ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.080922ms iteration = 21 status = {}
71532024-11-15T21:52:23.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7b9f5fb9-e2ea-454d-8ea0-4dafcbbe952a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
71542024-11-15T21:52:23.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7b9f5fb9-e2ea-454d-8ea0-4dafcbbe952a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
71552024-11-15T21:52:23.378ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
71562024-11-15T21:52:23.379ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "86f5b93b-62f5-4883-ad0b-0692b8c7642b", "content-length": "691", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
71572024-11-15T21:52:23.379ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
71582024-11-15T21:52:23.379ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
71592024-11-15T21:52:23.379ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
71602024-11-15T21:52:23.381ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
71612024-11-15T21:52:23.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71622024-11-15T21:52:23.381ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 351.21492ms iteration = 21 status = {}
71632024-11-15T21:52:23.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71642024-11-15T21:52:23.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7b9f5fb9-e2ea-454d-8ea0-4dafcbbe952a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
71652024-11-15T21:52:23.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71662024-11-15T21:52:23.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
71672024-11-15T21:52:23.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71682024-11-15T21:52:23.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71692024-11-15T21:52:23.386ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71702024-11-15T21:52:23.386ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fa44c70-4d74-428d-aede-a1be55904bbf", "content-length": "1", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
71712024-11-15T21:52:23.386ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
71722024-11-15T21:52:23.386ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
71732024-11-15T21:52:23.387ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
71742024-11-15T21:52:23.388ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71752024-11-15T21:52:23.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71762024-11-15T21:52:23.391ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 360.60563ms iteration = 21 status = null
71772024-11-15T21:52:23.393ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
71782024-11-15T21:52:23.393ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71792024-11-15T21:52:23.395ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fde944a7-14cd-49ba-8e10-f573aa802469", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
71802024-11-15T21:52:23.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71812024-11-15T21:52:23.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71822024-11-15T21:52:23.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71832024-11-15T21:52:23.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71842024-11-15T21:52:23.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71852024-11-15T21:52:23.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71862024-11-15T21:52:23.405ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71872024-11-15T21:52:23.405ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71882024-11-15T21:52:23.406ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "42c98c76-7429-42d7-9c67-e3172cb9b4f5", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
71892024-11-15T21:52:23.407ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 377.107687ms iteration = 22 status = {}
71902024-11-15T21:52:23.439ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 78d47478-5af8-488d-89c5-11be23443b63, time_created: 2024-11-15T21:42:21.206118Z, time_modified: 2024-11-15T21:42:21.206118Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
71912024-11-15T21:52:23.439ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
71922024-11-15T21:52:23.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71932024-11-15T21:52:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71942024-11-15T21:52:23.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71952024-11-15T21:52:23.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71962024-11-15T21:52:23.443ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
71972024-11-15T21:52:23.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71982024-11-15T21:52:23.444ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f43f954f-013e-4fb1-9157-8f4a17b191a3", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
71992024-11-15T21:52:23.444ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72002024-11-15T21:52:23.446ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "238e63cd-366e-4fdd-8546-74fc0e94b1bc", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72012024-11-15T21:52:23.446ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72022024-11-15T21:52:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
72032024-11-15T21:52:23.449ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "12c8d385-e6ae-4cef-8b7f-9e1bd2672a80", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72042024-11-15T21:52:23.449ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72052024-11-15T21:52:23.451ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72062024-11-15T21:52:23.451ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 420.63728ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72072024-11-15T21:52:23.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72082024-11-15T21:52:23.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72092024-11-15T21:52:23.487ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
72102024-11-15T21:52:23.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72112024-11-15T21:52:23.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72122024-11-15T21:52:23.488ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
72132024-11-15T21:52:23.497ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "82842f3f-898c-4cc6-a55f-e6ecbb2fb317", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
72142024-11-15T21:52:23.503ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
72152024-11-15T21:52:23.503ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 473.323833ms
72162024-11-15T21:52:23.503ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 473.375053ms iteration = 3 status = {}
72172024-11-15T21:52:23.504ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72182024-11-15T21:52:23.505ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "273740d2-c1e3-480b-85d4-d1b76bb7cfd3", "content-length": "134", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
72192024-11-15T21:52:23.505ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72202024-11-15T21:52:23.505ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
72212024-11-15T21:52:23.505ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72222024-11-15T21:52:23.505ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72232024-11-15T21:52:23.505ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72242024-11-15T21:52:23.505ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72252024-11-15T21:52:23.505ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72262024-11-15T21:52:23.505ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72272024-11-15T21:52:23.505ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72282024-11-15T21:52:23.505ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72292024-11-15T21:52:23.506ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
72302024-11-15T21:52:23.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72312024-11-15T21:52:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72322024-11-15T21:52:23.507ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72332024-11-15T21:52:23.508ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b7f9201-38bb-4857-accf-39babccc2605", "content-length": "2", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
72342024-11-15T21:52:23.508ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72352024-11-15T21:52:23.508ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4e8e576-f592-4403-ba58-5d0a5ac74d70", "content-length": "52", "date": "Fri, 15 Nov 2024 21:52:23 GMT"} })
72362024-11-15T21:52:23.508ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
72372024-11-15T21:52:23.508ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72382024-11-15T21:52:23.776ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f97e95ea-d54c-4fe6-922f-29403da4553c", "date": "Fri, 15 Nov 2024 21:52:22 GMT"} })
72392024-11-15T21:52:23.776ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
72402024-11-15T21:52:23.776ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72412024-11-15T21:52:23.777ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b946de9-018b-4a54-9801-b0e8c377bbe4", "content-length": "682", "date": "Fri, 15 Nov 2024 21:52:22 GMT"} })
72422024-11-15T21:52:23.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72432024-11-15T21:52:23.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72442024-11-15T21:52:23.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72452024-11-15T21:52:23.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72462024-11-15T21:52:23.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72472024-11-15T21:52:23.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72482024-11-15T21:52:23.787ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72492024-11-15T21:52:23.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72502024-11-15T21:52:23.795ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 764.350021ms iteration = 21 status = {}
72512024-11-15T21:52:24.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 68fbedd6-766b-4879-bd2d-e4f05b62366e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
72522024-11-15T21:52:24.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 68fbedd6-766b-4879-bd2d-e4f05b62366e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
72532024-11-15T21:52:24.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 68fbedd6-766b-4879-bd2d-e4f05b62366e response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
72542024-11-15T21:52:24.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0a847fc5-eea6-4d95-a8f5-401609427439 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
72552024-11-15T21:52:24.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0a847fc5-eea6-4d95-a8f5-401609427439 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
72562024-11-15T21:52:24.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0a847fc5-eea6-4d95-a8f5-401609427439 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
72572024-11-15T21:52:24.477ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
72582024-11-15T21:52:24.477ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
72592024-11-15T21:52:24.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
72602024-11-15T21:52:24.479ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72612024-11-15T21:52:24.481ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
72622024-11-15T21:52:24.481ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
72632024-11-15T21:52:24.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
72642024-11-15T21:52:24.494ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(b587e686-431f-4072-b5d1-5c0f3af71356, 0), (794aa79a-3cb5-44bf-a5d1-ac38e1f914a8, 0), (0c622f24-8561-43de-85bd-81298dd6ff47, 0), (40777b18-8004-4213-8ee8-b8cd9df863fb, 0)] collection_id = b587e686-431f-4072-b5d1-5c0f3af71356
72652024-11-15T21:52:24.494ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
72662024-11-15T21:52:24.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
72672024-11-15T21:52:24.556ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = b587e686-431f-4072-b5d1-5c0f3af71356 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
72682024-11-15T21:52:24.556ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
72692024-11-15T21:52:24.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
72702024-11-15T21:52:24.575ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(794aa79a-3cb5-44bf-a5d1-ac38e1f914a8, 0), (0c622f24-8561-43de-85bd-81298dd6ff47, 0), (40777b18-8004-4213-8ee8-b8cd9df863fb, 0), (23d11a2f-590b-43a5-a30b-17addf52fd34, 0)] collection_id = 794aa79a-3cb5-44bf-a5d1-ac38e1f914a8
72712024-11-15T21:52:24.575ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
72722024-11-15T21:52:24.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
72732024-11-15T21:52:24.620ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 794aa79a-3cb5-44bf-a5d1-ac38e1f914a8 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
72742024-11-15T21:52:24.620ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
72752024-11-15T21:52:24.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
72762024-11-15T21:52:24.627ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(0c622f24-8561-43de-85bd-81298dd6ff47, 0), (40777b18-8004-4213-8ee8-b8cd9df863fb, 0), (23d11a2f-590b-43a5-a30b-17addf52fd34, 0)]
72772024-11-15T21:52:24.627ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1626, tv_nsec: 570131148 } })
72782024-11-15T21:52:24.658ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
72792024-11-15T21:52:24.658ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
72802024-11-15T21:52:24.658ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
72812024-11-15T21:52:24.658ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "772bb306-b3c6-4830-a1bd-52593f2356cd", "content-length": "476", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
72822024-11-15T21:52:24.658ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
72832024-11-15T21:52:24.658ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e9bb5f3-dad5-464e-a642-756a26dbf35c", "content-length": "734", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
72842024-11-15T21:52:24.658ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
72852024-11-15T21:52:24.659ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c13577b2-7d7b-4eb1-9a1d-1e0fdea52f1b", "content-length": "111", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
72862024-11-15T21:52:24.659ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
72872024-11-15T21:52:24.659ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7b9b9bf-9e60-497c-b9bf-57bf7896a458", "content-length": "111", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
72882024-11-15T21:52:24.659ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
72892024-11-15T21:52:24.659ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f99de2e-7fe0-4084-bcc9-16ef0312b257", "content-length": "167", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
72902024-11-15T21:52:24.659ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
72912024-11-15T21:52:24.659ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f908031-9687-418c-8e39-9a4735ed4017", "content-length": "167", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
72922024-11-15T21:52:24.659ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
72932024-11-15T21:52:24.660ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4369fe7-d750-4282-8523-7d935b5ad599", "content-length": "175", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
72942024-11-15T21:52:24.660ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
72952024-11-15T21:52:24.660ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a306ef0a-dce5-46eb-89ac-4f9ad0edf223", "content-length": "175", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
72962024-11-15T21:52:24.660ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
72972024-11-15T21:52:24.660ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0ada7fe-ad48-435e-9ac9-3ed87ee36cb5", "content-length": "702", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
72982024-11-15T21:52:24.660ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
72992024-11-15T21:52:24.660ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa3c1e8a-48e2-45d1-aadb-07b5b9ff0118", "content-length": "727", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73002024-11-15T21:52:24.660ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
73012024-11-15T21:52:24.660ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ac53a6f-16ce-4bd3-a90e-9d3f63a752f6", "content-length": "729", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73022024-11-15T21:52:24.660ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
73032024-11-15T21:52:24.661ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e59e00ff-c801-468d-8e87-e9380a6b6b0a", "content-length": "728", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73042024-11-15T21:52:24.661ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
73052024-11-15T21:52:24.661ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1695271e-aa39-4da9-81ed-7113911c4d65", "content-length": "722", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73062024-11-15T21:52:24.661ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
73072024-11-15T21:52:24.661ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f6038c3-4ff3-4452-9e81-5bc15f1c9dee", "content-length": "109", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73082024-11-15T21:52:24.661ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
73092024-11-15T21:52:24.661ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6236e2fd-cd02-468f-8170-7aea18e76847", "content-length": "109", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73102024-11-15T21:52:24.661ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
73112024-11-15T21:52:24.661ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "67dff54b-2ae6-41c6-b9d0-ec044068b1d7", "content-length": "169", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73122024-11-15T21:52:24.661ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
73132024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cbc0003-d1db-4363-a485-33a5934bf8a2", "content-length": "169", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73142024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
73152024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a3a8c04-9837-47dd-a0ea-de771b132e99", "content-length": "178", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73162024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
73172024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d8f718d-822b-4502-933c-6d309c66d1f9", "content-length": "178", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73182024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
73192024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb465610-534b-44ce-8fc3-ae0570b91753", "content-length": "702", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73202024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
73212024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cc83118-9dfb-472b-a764-2a73843f583e", "content-length": "727", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73222024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
73232024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "88a9e5ae-ee0b-409f-a816-2bf36e8a98a0", "content-length": "729", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73242024-11-15T21:52:24.662ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
73252024-11-15T21:52:24.663ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "486366ce-4000-4a19-8f95-6099410fed1e", "content-length": "728", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73262024-11-15T21:52:24.663ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73272024-11-15T21:52:24.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73282024-11-15T21:52:24.665ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73292024-11-15T21:52:24.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
73302024-11-15T21:52:24.666ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73312024-11-15T21:52:24.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73322024-11-15T21:52:24.668ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73332024-11-15T21:52:24.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
73342024-11-15T21:52:24.670ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73352024-11-15T21:52:24.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73362024-11-15T21:52:24.756ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
73372024-11-15T21:52:24.756ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
73382024-11-15T21:52:24.969ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d0b6cb5-fac4-4f96-a0fe-1eee6a009bd7", "content-length": "30758", "date": "Fri, 15 Nov 2024 21:52:24 GMT"} })
73392024-11-15T21:52:24.971ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
73402024-11-15T21:52:24.971ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
73412024-11-15T21:52:24.971ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
73422024-11-15T21:52:24.973ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73432024-11-15T21:52:24.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73442024-11-15T21:52:24.974ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73452024-11-15T21:52:24.976ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
73462024-11-15T21:52:24.976ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73472024-11-15T21:52:24.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73482024-11-15T21:52:25.148ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = ae8bd1d8-d674-4265-ad75-539d98d4b9e5 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
73492024-11-15T21:52:25.148ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = ae8bd1d8-d674-4265-ad75-539d98d4b9e5 time_started = 2024-11-15 21:52:24.658372 UTC
73502024-11-15T21:52:25.148ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 671.236576ms iteration = 4 status = {"collection_id":"ae8bd1d8-d674-4265-ad75-539d98d4b9e5","time_done":"2024-11-15 21:52:24.971487 UTC","time_started":"2024-11-15 21:52:24.658372 UTC"}
73512024-11-15T21:52:25.148ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
73522024-11-15T21:52:25.148ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73532024-11-15T21:52:25.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73542024-11-15T21:52:25.151ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73552024-11-15T21:52:25.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73562024-11-15T21:52:25.152ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73572024-11-15T21:52:25.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73582024-11-15T21:52:25.155ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73592024-11-15T21:52:25.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73602024-11-15T21:52:25.157ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73612024-11-15T21:52:25.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73622024-11-15T21:52:25.159ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73632024-11-15T21:52:25.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73642024-11-15T21:52:25.167ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 18.949153ms iteration = 25 status = {"physical_disks_added":0}
73652024-11-15T21:52:25.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d80b9c1d-d12b-4c15-9afc-b59d514d80a8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73662024-11-15T21:52:25.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d80b9c1d-d12b-4c15-9afc-b59d514d80a8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73672024-11-15T21:52:25.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d80b9c1d-d12b-4c15-9afc-b59d514d80a8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73682024-11-15T21:52:26.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6179de50-8aec-4089-b3d0-00ad027cb6dd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73692024-11-15T21:52:26.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6179de50-8aec-4089-b3d0-00ad027cb6dd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73702024-11-15T21:52:26.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6179de50-8aec-4089-b3d0-00ad027cb6dd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73712024-11-15T21:52:27.122ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
73722024-11-15T21:52:27.122ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
73732024-11-15T21:52:27.153ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
73742024-11-15T21:52:27.153ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:45277
73752024-11-15T21:52:27.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45277 req_id = 2e3814b8-f678-4999-8fdd-7b3c8c844d13 roles = RoleSet { roles: {} } uri = /metrics/producers
73762024-11-15T21:52:27.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45277 req_id = 2e3814b8-f678-4999-8fdd-7b3c8c844d13 resource = Database result = Ok(()) uri = /metrics/producers
73772024-11-15T21:52:27.191ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
73782024-11-15T21:52:27.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37548 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45277 req_id = 2e3814b8-f678-4999-8fdd-7b3c8c844d13 response_code = 201 uri = /metrics/producers
73792024-11-15T21:52:27.191ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2e3814b8-f678-4999-8fdd-7b3c8c844d13", "content-length": "41", "date": "Fri, 15 Nov 2024 21:52:26 GMT"} })
73802024-11-15T21:52:27.192ZDEBGnexus (producer-registration-task): registered with nexus successfully
73812024-11-15T21:52:27.192ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
73822024-11-15T21:52:27.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 810364a2-54ee-45a1-9c43-92eb9b46339e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73832024-11-15T21:52:27.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 810364a2-54ee-45a1-9c43-92eb9b46339e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73842024-11-15T21:52:27.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 810364a2-54ee-45a1-9c43-92eb9b46339e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73852024-11-15T21:52:28.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fa6a6b22-18d2-497d-bdc2-beff1caf62aa roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73862024-11-15T21:52:28.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fa6a6b22-18d2-497d-bdc2-beff1caf62aa resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73872024-11-15T21:52:28.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fa6a6b22-18d2-497d-bdc2-beff1caf62aa response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73882024-11-15T21:52:29.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e9d77a76-f883-44e8-b724-9bcb1a9c0676 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73892024-11-15T21:52:29.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e9d77a76-f883-44e8-b724-9bcb1a9c0676 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73902024-11-15T21:52:29.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e9d77a76-f883-44e8-b724-9bcb1a9c0676 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73912024-11-15T21:52:30.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1422d527-0402-4b41-b681-5a96c40d42fa roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73922024-11-15T21:52:30.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1422d527-0402-4b41-b681-5a96c40d42fa resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73932024-11-15T21:52:30.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1422d527-0402-4b41-b681-5a96c40d42fa response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73942024-11-15T21:52:30.671ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1425 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 3f29f4f9-0e48-4f87-a8e2-bdf7b8e4695d response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
73952024-11-15T21:52:31.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5dd4c9fc-06b4-4752-8edb-3dec7ad76a27 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73962024-11-15T21:52:31.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5dd4c9fc-06b4-4752-8edb-3dec7ad76a27 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73972024-11-15T21:52:31.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5dd4c9fc-06b4-4752-8edb-3dec7ad76a27 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73982024-11-15T21:52:32.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 37dcf992-425e-4f4a-b820-e95dd89233ea roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
73992024-11-15T21:52:32.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 37dcf992-425e-4f4a-b820-e95dd89233ea resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74002024-11-15T21:52:32.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 37dcf992-425e-4f4a-b820-e95dd89233ea response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74012024-11-15T21:52:33.030ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
74022024-11-15T21:52:33.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74032024-11-15T21:52:33.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
74042024-11-15T21:52:33.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74052024-11-15T21:52:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74062024-11-15T21:52:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74072024-11-15T21:52:33.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74082024-11-15T21:52:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74092024-11-15T21:52:33.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74102024-11-15T21:52:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74112024-11-15T21:52:33.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74122024-11-15T21:52:33.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74132024-11-15T21:52:33.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74142024-11-15T21:52:33.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
74152024-11-15T21:52:33.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74162024-11-15T21:52:33.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74172024-11-15T21:52:33.056ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
74182024-11-15T21:52:33.056ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.131483ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
74192024-11-15T21:52:33.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74202024-11-15T21:52:33.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74212024-11-15T21:52:33.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.489153ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74222024-11-15T21:52:33.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f1e2a67b-27cd-4ee5-be83-5a57ca728bec roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74232024-11-15T21:52:33.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f1e2a67b-27cd-4ee5-be83-5a57ca728bec resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74242024-11-15T21:52:33.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f1e2a67b-27cd-4ee5-be83-5a57ca728bec response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74252024-11-15T21:52:34.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1b6c7ab-285c-4787-bc7f-a72154d8e52c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74262024-11-15T21:52:34.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1b6c7ab-285c-4787-bc7f-a72154d8e52c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74272024-11-15T21:52:34.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1b6c7ab-285c-4787-bc7f-a72154d8e52c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74282024-11-15T21:52:35.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 946d80d0-4bf1-4271-b18e-8f84e2866fe1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74292024-11-15T21:52:35.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 946d80d0-4bf1-4271-b18e-8f84e2866fe1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74302024-11-15T21:52:35.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d499f8c9-cf51-4368-a518-2e04d90dcf7c roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
74312024-11-15T21:52:35.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d499f8c9-cf51-4368-a518-2e04d90dcf7c resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
74322024-11-15T21:52:35.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 946d80d0-4bf1-4271-b18e-8f84e2866fe1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74332024-11-15T21:52:35.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d499f8c9-cf51-4368-a518-2e04d90dcf7c response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
74342024-11-15T21:52:35.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = bb9711a7-d74d-40e9-8576-702eca03c233 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
74352024-11-15T21:52:35.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = bb9711a7-d74d-40e9-8576-702eca03c233 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
74362024-11-15T21:52:35.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = bb9711a7-d74d-40e9-8576-702eca03c233 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
74372024-11-15T21:52:36.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fb592573-aca8-4ba7-a140-12b6ae67eb51 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74382024-11-15T21:52:36.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fb592573-aca8-4ba7-a140-12b6ae67eb51 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74392024-11-15T21:52:36.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fb592573-aca8-4ba7-a140-12b6ae67eb51 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74402024-11-15T21:52:37.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 55bb89a0-2965-4f66-8499-4946d2eb69dc roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74412024-11-15T21:52:37.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 55bb89a0-2965-4f66-8499-4946d2eb69dc resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74422024-11-15T21:52:37.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 55bb89a0-2965-4f66-8499-4946d2eb69dc response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74432024-11-15T21:52:38.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c92afdab-6071-4a39-b594-ad07f1b31776 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74442024-11-15T21:52:38.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c92afdab-6071-4a39-b594-ad07f1b31776 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74452024-11-15T21:52:38.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c92afdab-6071-4a39-b594-ad07f1b31776 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74462024-11-15T21:52:38.904ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42700
74472024-11-15T21:52:38.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42700 req_id = 2dd0d6ea-c884-44e9-93ae-380a9b9e97db roles = RoleSet { roles: {} } uri = /metrics/producers
74482024-11-15T21:52:38.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42700 req_id = 2dd0d6ea-c884-44e9-93ae-380a9b9e97db resource = Database result = Ok(()) uri = /metrics/producers
74492024-11-15T21:52:38.943ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 5e8fa613-d1c4-416c-8557-742a109ff40b
74502024-11-15T21:52:38.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38661 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42700 req_id = 2dd0d6ea-c884-44e9-93ae-380a9b9e97db response_code = 201 uri = /metrics/producers
74512024-11-15T21:52:39.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cd46027e-20c2-4337-b5ae-338d775864f9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74522024-11-15T21:52:39.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cd46027e-20c2-4337-b5ae-338d775864f9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74532024-11-15T21:52:39.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cd46027e-20c2-4337-b5ae-338d775864f9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74542024-11-15T21:52:40.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f177f935-48fa-4492-a1be-1a41520b95b4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74552024-11-15T21:52:40.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f177f935-48fa-4492-a1be-1a41520b95b4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74562024-11-15T21:52:40.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f177f935-48fa-4492-a1be-1a41520b95b4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74572024-11-15T21:52:41.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 20129177-986f-466d-9c75-2c43001cabd4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74582024-11-15T21:52:41.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 20129177-986f-466d-9c75-2c43001cabd4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74592024-11-15T21:52:41.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 20129177-986f-466d-9c75-2c43001cabd4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74602024-11-15T21:52:42.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e03e625a-3217-4b9c-8441-573c15643979 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74612024-11-15T21:52:42.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e03e625a-3217-4b9c-8441-573c15643979 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74622024-11-15T21:52:42.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e03e625a-3217-4b9c-8441-573c15643979 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74632024-11-15T21:52:43.031ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
74642024-11-15T21:52:43.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
74652024-11-15T21:52:43.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74662024-11-15T21:52:43.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74672024-11-15T21:52:43.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74682024-11-15T21:52:43.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74692024-11-15T21:52:43.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74702024-11-15T21:52:43.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74712024-11-15T21:52:43.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74722024-11-15T21:52:43.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74732024-11-15T21:52:43.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74742024-11-15T21:52:43.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74752024-11-15T21:52:43.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74762024-11-15T21:52:43.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
74772024-11-15T21:52:43.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74782024-11-15T21:52:43.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74792024-11-15T21:52:43.058ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
74802024-11-15T21:52:43.058ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.776474ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
74812024-11-15T21:52:43.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74822024-11-15T21:52:43.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74832024-11-15T21:52:43.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.268452ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74842024-11-15T21:52:43.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7eb3ac0e-bdba-42fd-9e01-d954d49f1bb0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74852024-11-15T21:52:43.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7eb3ac0e-bdba-42fd-9e01-d954d49f1bb0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74862024-11-15T21:52:43.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7eb3ac0e-bdba-42fd-9e01-d954d49f1bb0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74872024-11-15T21:52:44.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d221516-3355-47ef-8155-8bc274bbdd25 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74882024-11-15T21:52:44.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d221516-3355-47ef-8155-8bc274bbdd25 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74892024-11-15T21:52:44.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5d221516-3355-47ef-8155-8bc274bbdd25 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74902024-11-15T21:52:45.672ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 1cf85ee4-6542-4482-8521-ec595624e12c response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
74912024-11-15T21:52:45.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 611adb03-25ba-475b-8542-0ee78616ea8b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74922024-11-15T21:52:45.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 611adb03-25ba-475b-8542-0ee78616ea8b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74932024-11-15T21:52:45.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 611adb03-25ba-475b-8542-0ee78616ea8b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74942024-11-15T21:52:46.949ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:40685
74952024-11-15T21:52:46.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4e3eab45-d8c3-4877-8a08-5eaaf7343d10 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74962024-11-15T21:52:46.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40685 req_id = 3ae78b3a-e494-46ad-b9e0-086a7e408be6 roles = RoleSet { roles: {} } uri = /metrics/producers
74972024-11-15T21:52:46.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4e3eab45-d8c3-4877-8a08-5eaaf7343d10 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
74982024-11-15T21:52:46.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40685 req_id = 3ae78b3a-e494-46ad-b9e0-086a7e408be6 resource = Database result = Ok(()) uri = /metrics/producers
74992024-11-15T21:52:46.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4e3eab45-d8c3-4877-8a08-5eaaf7343d10 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75002024-11-15T21:52:46.960ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 78d47478-5af8-488d-89c5-11be23443b63
75012024-11-15T21:52:46.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11483 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40685 req_id = 3ae78b3a-e494-46ad-b9e0-086a7e408be6 response_code = 201 uri = /metrics/producers
75022024-11-15T21:52:47.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 766838b6-4eb2-45e9-9fe1-b0d201c3f3c5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75032024-11-15T21:52:47.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 766838b6-4eb2-45e9-9fe1-b0d201c3f3c5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75042024-11-15T21:52:47.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1689 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 766838b6-4eb2-45e9-9fe1-b0d201c3f3c5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75052024-11-15T21:52:48.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 105a281e-11af-47c4-8f16-43773cc29389 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75062024-11-15T21:52:48.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 105a281e-11af-47c4-8f16-43773cc29389 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75072024-11-15T21:52:48.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 105a281e-11af-47c4-8f16-43773cc29389 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75082024-11-15T21:52:50.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 530a59aa-6197-4522-8048-77f96d715126 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75092024-11-15T21:52:50.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 530a59aa-6197-4522-8048-77f96d715126 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75102024-11-15T21:52:50.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 530a59aa-6197-4522-8048-77f96d715126 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75112024-11-15T21:52:51.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = acc39479-fb9b-4b57-b7d2-ff076bf121db roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75122024-11-15T21:52:51.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = acc39479-fb9b-4b57-b7d2-ff076bf121db resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75132024-11-15T21:52:51.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = acc39479-fb9b-4b57-b7d2-ff076bf121db response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75142024-11-15T21:52:52.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4f035cb0-b338-4b83-adca-19d7bfb3dc70 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75152024-11-15T21:52:52.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4f035cb0-b338-4b83-adca-19d7bfb3dc70 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75162024-11-15T21:52:52.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4f035cb0-b338-4b83-adca-19d7bfb3dc70 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
75172024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
75182024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
75192024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75202024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75212024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
75222024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75232024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
75242024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
75252024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75262024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75272024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
75282024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75292024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
75302024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75312024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
75322024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75332024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75342024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
75352024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
75362024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
75372024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
75382024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75392024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75402024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75412024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
75422024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75432024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
75442024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75452024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
75462024-11-15T21:52:53.032ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75472024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75482024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
75492024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75502024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
75512024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75522024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75532024-11-15T21:52:53.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75542024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75552024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75562024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75572024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75582024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75592024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75602024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75612024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75622024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75632024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75642024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75652024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75662024-11-15T21:52:53.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75672024-11-15T21:52:53.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75682024-11-15T21:52:53.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75692024-11-15T21:52:53.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75702024-11-15T21:52:53.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75712024-11-15T21:52:53.036ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.162647ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75722024-11-15T21:52:53.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1654, tv_nsec: 978654508 } })
75732024-11-15T21:52:53.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
75742024-11-15T21:52:53.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75752024-11-15T21:52:53.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75762024-11-15T21:52:53.038ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75772024-11-15T21:52:53.038ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75782024-11-15T21:52:53.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75792024-11-15T21:52:53.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75802024-11-15T21:52:53.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75812024-11-15T21:52:53.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75822024-11-15T21:52:53.040ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1654, tv_nsec: 981709578 } })
75832024-11-15T21:52:53.042ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
75842024-11-15T21:52:53.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.695129ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
75852024-11-15T21:52:53.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75862024-11-15T21:52:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75872024-11-15T21:52:53.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75882024-11-15T21:52:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75892024-11-15T21:52:53.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75902024-11-15T21:52:53.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75912024-11-15T21:52:53.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75922024-11-15T21:52:53.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75932024-11-15T21:52:53.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75942024-11-15T21:52:53.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.206901ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
75952024-11-15T21:52:53.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75962024-11-15T21:52:53.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75972024-11-15T21:52:53.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75982024-11-15T21:52:53.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75992024-11-15T21:52:53.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76002024-11-15T21:52:53.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76012024-11-15T21:52:53.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76022024-11-15T21:52:53.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76032024-11-15T21:52:53.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76042024-11-15T21:52:53.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76052024-11-15T21:52:53.057ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.425425ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76062024-11-15T21:52:53.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76072024-11-15T21:52:53.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76082024-11-15T21:52:53.060ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76092024-11-15T21:52:53.060ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76102024-11-15T21:52:53.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76112024-11-15T21:52:53.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76122024-11-15T21:52:53.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76132024-11-15T21:52:53.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76142024-11-15T21:52:53.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76152024-11-15T21:52:53.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76162024-11-15T21:52:53.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76172024-11-15T21:52:53.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76182024-11-15T21:52:53.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76192024-11-15T21:52:53.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76202024-11-15T21:52:53.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76212024-11-15T21:52:53.062ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 3235438 } })
76222024-11-15T21:52:53.062ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
76232024-11-15T21:52:53.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76242024-11-15T21:52:53.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76252024-11-15T21:52:53.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76262024-11-15T21:52:53.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 32.615911ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76272024-11-15T21:52:53.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76282024-11-15T21:52:53.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76292024-11-15T21:52:53.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76302024-11-15T21:52:53.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76312024-11-15T21:52:53.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76322024-11-15T21:52:53.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76332024-11-15T21:52:53.080ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76342024-11-15T21:52:53.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76352024-11-15T21:52:53.083ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76362024-11-15T21:52:53.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76372024-11-15T21:52:53.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76382024-11-15T21:52:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76392024-11-15T21:52:53.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76402024-11-15T21:52:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76412024-11-15T21:52:53.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76422024-11-15T21:52:53.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 54.125371ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76432024-11-15T21:52:53.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76442024-11-15T21:52:53.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76452024-11-15T21:52:53.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
76462024-11-15T21:52:53.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76472024-11-15T21:52:53.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76482024-11-15T21:52:53.092ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.685308ms iteration = 22 status = 0
76492024-11-15T21:52:53.092ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76502024-11-15T21:52:53.092ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76512024-11-15T21:52:53.092ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.331591ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76522024-11-15T21:52:53.093ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76532024-11-15T21:52:53.093ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.730275ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76542024-11-15T21:52:53.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76552024-11-15T21:52:53.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76562024-11-15T21:52:53.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76572024-11-15T21:52:53.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76582024-11-15T21:52:53.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76592024-11-15T21:52:53.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
76602024-11-15T21:52:53.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76612024-11-15T21:52:53.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76622024-11-15T21:52:53.115ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76632024-11-15T21:52:53.116ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 84.030296ms iteration = 26 status = {"physical_disks_added":0}
76642024-11-15T21:52:53.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76652024-11-15T21:52:53.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76662024-11-15T21:52:53.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76672024-11-15T21:52:53.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.343954ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
76682024-11-15T21:52:53.120ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
76692024-11-15T21:52:53.120ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76702024-11-15T21:52:53.121ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "187f9b84-6fcb-4baa-9148-e25021b58550", "content-length": "26", "date": "Fri, 15 Nov 2024 21:52:52 GMT"} })
76712024-11-15T21:52:53.121ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76722024-11-15T21:52:53.122ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76732024-11-15T21:52:53.125ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
76742024-11-15T21:52:53.125ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.536921ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
76752024-11-15T21:52:53.167ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
76762024-11-15T21:52:53.167ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76772024-11-15T21:52:53.167ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cb7bae1-e0f8-4025-b1e6-7253364780b0", "content-length": "26", "date": "Fri, 15 Nov 2024 21:52:52 GMT"} })
76782024-11-15T21:52:53.167ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76792024-11-15T21:52:53.169ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76802024-11-15T21:52:53.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a15c88c1-dbe6-459e-b953-8d80890b7dd8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
76812024-11-15T21:52:53.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a15c88c1-dbe6-459e-b953-8d80890b7dd8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
76822024-11-15T21:52:53.225ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
76832024-11-15T21:52:53.225ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76842024-11-15T21:52:53.225ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fad2e122-69d6-4bfb-b6d2-b3c18a9a8869", "content-length": "26", "date": "Fri, 15 Nov 2024 21:52:52 GMT"} })
76852024-11-15T21:52:53.225ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76862024-11-15T21:52:53.227ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
76872024-11-15T21:52:53.253ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76882024-11-15T21:52:53.255ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 222.576894ms iteration = 22 status = {}
76892024-11-15T21:52:53.255ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "36d5c69a-b091-4fbe-b4c5-f01f881e2cc6", "content-length": "691", "date": "Fri, 15 Nov 2024 21:52:52 GMT"} })
76902024-11-15T21:52:53.255ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
76912024-11-15T21:52:53.255ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
76922024-11-15T21:52:53.255ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
76932024-11-15T21:52:53.257ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 225.155202ms iteration = 22 status = {}
76942024-11-15T21:52:53.265ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76952024-11-15T21:52:53.266ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "68340715-0f20-4732-b3eb-f67c068616af", "content-length": "1", "date": "Fri, 15 Nov 2024 21:52:52 GMT"} })
76962024-11-15T21:52:53.268ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76972024-11-15T21:52:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76982024-11-15T21:52:53.272ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76992024-11-15T21:52:53.272ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77002024-11-15T21:52:53.272ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa634b46-b672-40d7-8a21-e133632404b0", "content-length": "372", "date": "Fri, 15 Nov 2024 21:52:52 GMT"} })
77012024-11-15T21:52:53.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77022024-11-15T21:52:53.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77032024-11-15T21:52:53.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94898 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a15c88c1-dbe6-459e-b953-8d80890b7dd8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77042024-11-15T21:52:53.274ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 242.068221ms iteration = 22 status = null
77052024-11-15T21:52:53.287ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
77062024-11-15T21:52:53.287ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77072024-11-15T21:52:53.288ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3f7f3b0c-02d2-4b70-b98a-2319c5295897", "date": "Fri, 15 Nov 2024 21:52:53 GMT"} })
77082024-11-15T21:52:53.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77092024-11-15T21:52:53.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77102024-11-15T21:52:53.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77112024-11-15T21:52:53.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77122024-11-15T21:52:53.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77132024-11-15T21:52:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77142024-11-15T21:52:53.296ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77152024-11-15T21:52:53.296ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77162024-11-15T21:52:53.296ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "245fb4b1-8c40-4d99-8f2b-b3050ace452e", "date": "Fri, 15 Nov 2024 21:52:53 GMT"} })
77172024-11-15T21:52:53.298ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 265.454593ms iteration = 23 status = {}
77182024-11-15T21:52:53.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77192024-11-15T21:52:53.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77202024-11-15T21:52:53.343ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
77212024-11-15T21:52:53.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77222024-11-15T21:52:53.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77232024-11-15T21:52:53.352ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77242024-11-15T21:52:53.352ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "83866595-dd07-421e-bce9-9c4f88785dfc", "content-length": "134", "date": "Fri, 15 Nov 2024 21:52:53 GMT"} })
77252024-11-15T21:52:53.352ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77262024-11-15T21:52:53.352ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
77272024-11-15T21:52:53.352ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77282024-11-15T21:52:53.352ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77292024-11-15T21:52:53.352ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77302024-11-15T21:52:53.352ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77312024-11-15T21:52:53.352ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77322024-11-15T21:52:53.352ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77332024-11-15T21:52:53.353ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77342024-11-15T21:52:53.353ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77352024-11-15T21:52:53.353ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
77362024-11-15T21:52:53.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77372024-11-15T21:52:53.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77382024-11-15T21:52:53.355ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77392024-11-15T21:52:53.355ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "db606924-f9dd-4fad-a9d5-4a13233ac25f", "content-length": "2", "date": "Fri, 15 Nov 2024 21:52:53 GMT"} })
77402024-11-15T21:52:53.355ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
77412024-11-15T21:52:53.355ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "571a2871-3bbf-4194-a448-68f2f551f743", "content-length": "52", "date": "Fri, 15 Nov 2024 21:52:53 GMT"} })
77422024-11-15T21:52:53.355ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
77432024-11-15T21:52:53.355ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
77442024-11-15T21:52:53.439ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "97abba92-ab5f-4d42-80aa-611757155c18", "date": "Fri, 15 Nov 2024 21:52:53 GMT"} })
77452024-11-15T21:52:53.439ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
77462024-11-15T21:52:53.439ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
77472024-11-15T21:52:53.439ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "56ed55d3-2607-481d-b296-3da12981660f", "content-length": "682", "date": "Fri, 15 Nov 2024 21:52:53 GMT"} })
77482024-11-15T21:52:53.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77492024-11-15T21:52:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77502024-11-15T21:52:53.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77512024-11-15T21:52:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77522024-11-15T21:52:53.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77532024-11-15T21:52:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77542024-11-15T21:52:53.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77552024-11-15T21:52:53.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77562024-11-15T21:52:53.457ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 425.152999ms iteration = 22 status = {}
77572024-11-15T21:52:54.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 320fb02c-f338-490c-9966-306b57d938f9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
77582024-11-15T21:52:54.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 320fb02c-f338-490c-9966-306b57d938f9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
77592024-11-15T21:52:54.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 320fb02c-f338-490c-9966-306b57d938f9 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
77602024-11-15T21:52:54.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b354e2b3-fc51-43b7-b5a3-6c3743c6bc31 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77612024-11-15T21:52:54.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b354e2b3-fc51-43b7-b5a3-6c3743c6bc31 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77622024-11-15T21:52:54.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b354e2b3-fc51-43b7-b5a3-6c3743c6bc31 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77632024-11-15T21:52:54.845ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52557
77642024-11-15T21:52:54.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52557 req_id = 8fda134d-86a8-472f-8dc5-4cf03705abb2 roles = RoleSet { roles: {} } uri = /metrics/producers
77652024-11-15T21:52:54.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52557 req_id = 8fda134d-86a8-472f-8dc5-4cf03705abb2 resource = Database result = Ok(()) uri = /metrics/producers
77662024-11-15T21:52:54.855ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 17a6b664-61ae-47e8-9c94-fdc7e3f8e300
77672024-11-15T21:52:54.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10302 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52557 req_id = 8fda134d-86a8-472f-8dc5-4cf03705abb2 response_code = 201 uri = /metrics/producers
77682024-11-15T21:52:55.044ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51361
77692024-11-15T21:52:55.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51361 req_id = d121d307-2790-490c-838a-b3245ebf682b roles = RoleSet { roles: {} } uri = /metrics/producers
77702024-11-15T21:52:55.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51361 req_id = d121d307-2790-490c-838a-b3245ebf682b resource = Database result = Ok(()) uri = /metrics/producers
77712024-11-15T21:52:55.086ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 1ee9a34a-c3be-49f8-8ccd-8456768402b0
77722024-11-15T21:52:55.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41989 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51361 req_id = d121d307-2790-490c-838a-b3245ebf682b response_code = 201 uri = /metrics/producers
77732024-11-15T21:52:55.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7bacbfcb-c2e1-42de-b5ab-f721e23ee2b5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77742024-11-15T21:52:55.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7bacbfcb-c2e1-42de-b5ab-f721e23ee2b5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77752024-11-15T21:52:55.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7bacbfcb-c2e1-42de-b5ab-f721e23ee2b5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77762024-11-15T21:52:56.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f9d19212-833d-4e80-9477-27bf83b91e56 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77772024-11-15T21:52:56.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f9d19212-833d-4e80-9477-27bf83b91e56 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77782024-11-15T21:52:56.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f9d19212-833d-4e80-9477-27bf83b91e56 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77792024-11-15T21:52:57.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 56909933-d8e5-4d17-bd78-803fa5a63101 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77802024-11-15T21:52:57.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 56909933-d8e5-4d17-bd78-803fa5a63101 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77812024-11-15T21:52:57.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 56909933-d8e5-4d17-bd78-803fa5a63101 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77822024-11-15T21:52:58.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c77d0b77-97b7-4462-9d03-4bb365598db8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77832024-11-15T21:52:58.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c77d0b77-97b7-4462-9d03-4bb365598db8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77842024-11-15T21:52:58.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c77d0b77-97b7-4462-9d03-4bb365598db8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77852024-11-15T21:52:59.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 301f1ddc-a6e9-47a4-88bd-678d4defdc7a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77862024-11-15T21:52:59.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 301f1ddc-a6e9-47a4-88bd-678d4defdc7a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77872024-11-15T21:52:59.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 301f1ddc-a6e9-47a4-88bd-678d4defdc7a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77882024-11-15T21:53:00.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 373cfb42-67f5-4869-8c85-03cb47efd550 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77892024-11-15T21:53:00.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 373cfb42-67f5-4869-8c85-03cb47efd550 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77902024-11-15T21:53:00.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 373cfb42-67f5-4869-8c85-03cb47efd550 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77912024-11-15T21:53:00.674ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1625 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 2352cfeb-7b8b-4c4c-9615-7a49a4723f09 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
77922024-11-15T21:53:01.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0605ee7-5a6f-4761-94bb-2b3c5ba1d22a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77932024-11-15T21:53:01.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0605ee7-5a6f-4761-94bb-2b3c5ba1d22a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77942024-11-15T21:53:01.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0605ee7-5a6f-4761-94bb-2b3c5ba1d22a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77952024-11-15T21:53:02.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ed07a52a-af4c-487a-ab34-f66e223a13d7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77962024-11-15T21:53:02.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ed07a52a-af4c-487a-ab34-f66e223a13d7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77972024-11-15T21:53:02.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ed07a52a-af4c-487a-ab34-f66e223a13d7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
77982024-11-15T21:53:03.037ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
77992024-11-15T21:53:03.037ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78002024-11-15T21:53:03.037ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
78012024-11-15T21:53:03.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78022024-11-15T21:53:03.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78032024-11-15T21:53:03.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78042024-11-15T21:53:03.039ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78052024-11-15T21:53:03.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78062024-11-15T21:53:03.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78072024-11-15T21:53:03.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78082024-11-15T21:53:03.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78092024-11-15T21:53:03.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78102024-11-15T21:53:03.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78112024-11-15T21:53:03.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78122024-11-15T21:53:03.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78132024-11-15T21:53:03.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
78142024-11-15T21:53:03.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78152024-11-15T21:53:03.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78162024-11-15T21:53:03.060ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
78172024-11-15T21:53:03.060ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.17054ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
78182024-11-15T21:53:03.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.508121ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78192024-11-15T21:53:03.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca1d15af-c8a9-4e5c-ada9-0a67dfe38107 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78202024-11-15T21:53:03.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca1d15af-c8a9-4e5c-ada9-0a67dfe38107 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78212024-11-15T21:53:03.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca1d15af-c8a9-4e5c-ada9-0a67dfe38107 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78222024-11-15T21:53:04.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3c07fbc7-5644-42b8-bb9e-8723507bfed0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78232024-11-15T21:53:04.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3c07fbc7-5644-42b8-bb9e-8723507bfed0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78242024-11-15T21:53:04.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3c07fbc7-5644-42b8-bb9e-8723507bfed0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78252024-11-15T21:53:05.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8471ea78-9def-4997-9449-e9182045a38d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78262024-11-15T21:53:05.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8471ea78-9def-4997-9449-e9182045a38d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78272024-11-15T21:53:05.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8471ea78-9def-4997-9449-e9182045a38d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78282024-11-15T21:53:06.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e3bc7762-9fa8-4578-ae8e-ce700770e403 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78292024-11-15T21:53:06.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e3bc7762-9fa8-4578-ae8e-ce700770e403 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78302024-11-15T21:53:06.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e3bc7762-9fa8-4578-ae8e-ce700770e403 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78312024-11-15T21:53:07.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3f3873a6-e332-451e-a804-a561cb162b21 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78322024-11-15T21:53:07.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3f3873a6-e332-451e-a804-a561cb162b21 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78332024-11-15T21:53:07.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3f3873a6-e332-451e-a804-a561cb162b21 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78342024-11-15T21:53:08.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31144c43-9af5-4713-9fe8-270984748b2e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78352024-11-15T21:53:08.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31144c43-9af5-4713-9fe8-270984748b2e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78362024-11-15T21:53:08.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31144c43-9af5-4713-9fe8-270984748b2e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78372024-11-15T21:53:09.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0b4d1149-16a5-47e5-afe9-6848d352c314 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78382024-11-15T21:53:09.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0b4d1149-16a5-47e5-afe9-6848d352c314 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78392024-11-15T21:53:09.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0b4d1149-16a5-47e5-afe9-6848d352c314 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78402024-11-15T21:53:10.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3ec31132-345b-49a0-a4ce-873daa706832 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78412024-11-15T21:53:10.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3ec31132-345b-49a0-a4ce-873daa706832 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78422024-11-15T21:53:10.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3ec31132-345b-49a0-a4ce-873daa706832 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78432024-11-15T21:53:11.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d5f75bda-13eb-4fd7-9efe-086f5f4760a7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78442024-11-15T21:53:11.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d5f75bda-13eb-4fd7-9efe-086f5f4760a7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78452024-11-15T21:53:11.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d5f75bda-13eb-4fd7-9efe-086f5f4760a7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78462024-11-15T21:53:12.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ef872fdf-1a1e-4c86-b219-465b3f25397a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78472024-11-15T21:53:12.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ef872fdf-1a1e-4c86-b219-465b3f25397a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78482024-11-15T21:53:12.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ef872fdf-1a1e-4c86-b219-465b3f25397a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78492024-11-15T21:53:13.050ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
78502024-11-15T21:53:13.050ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
78512024-11-15T21:53:13.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78522024-11-15T21:53:13.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78532024-11-15T21:53:13.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78542024-11-15T21:53:13.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78552024-11-15T21:53:13.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78562024-11-15T21:53:13.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78572024-11-15T21:53:13.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78582024-11-15T21:53:13.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.097616ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78592024-11-15T21:53:13.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78602024-11-15T21:53:13.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78612024-11-15T21:53:13.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78622024-11-15T21:53:13.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78632024-11-15T21:53:13.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78642024-11-15T21:53:13.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78652024-11-15T21:53:13.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
78662024-11-15T21:53:13.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78672024-11-15T21:53:13.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78682024-11-15T21:53:13.072ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
78692024-11-15T21:53:13.072ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.983442ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
78702024-11-15T21:53:13.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c32cf310-700f-4aca-b88e-5ec8009b028e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78712024-11-15T21:53:13.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c32cf310-700f-4aca-b88e-5ec8009b028e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78722024-11-15T21:53:13.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c32cf310-700f-4aca-b88e-5ec8009b028e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78732024-11-15T21:53:14.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac193f71-2d03-473f-9880-a6f7a0f91e5f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78742024-11-15T21:53:14.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac193f71-2d03-473f-9880-a6f7a0f91e5f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78752024-11-15T21:53:14.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac193f71-2d03-473f-9880-a6f7a0f91e5f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78762024-11-15T21:53:15.563ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46408
78772024-11-15T21:53:15.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46408 req_id = b911ed3e-d68a-466b-8c1d-e7885de7300e roles = RoleSet { roles: {} } uri = /metrics/producers
78782024-11-15T21:53:15.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46408 req_id = b911ed3e-d68a-466b-8c1d-e7885de7300e resource = Database result = Ok(()) uri = /metrics/producers
78792024-11-15T21:53:15.575ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 97598fa2-4ef4-4fda-9111-75c99f8284f6
78802024-11-15T21:53:15.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12116 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46408 req_id = b911ed3e-d68a-466b-8c1d-e7885de7300e response_code = 201 uri = /metrics/producers
78812024-11-15T21:53:15.694ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1256 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = beec7bda-acf8-43d1-bfc4-0f8b4f1d942b response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
78822024-11-15T21:53:15.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 74ac977b-a0d0-40bf-a2eb-5a34d0cbec0a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78832024-11-15T21:53:15.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 74ac977b-a0d0-40bf-a2eb-5a34d0cbec0a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78842024-11-15T21:53:15.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 74ac977b-a0d0-40bf-a2eb-5a34d0cbec0a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78852024-11-15T21:53:16.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a86836fc-9e35-4a35-be58-d4a43bfb9d2b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78862024-11-15T21:53:16.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a86836fc-9e35-4a35-be58-d4a43bfb9d2b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78872024-11-15T21:53:16.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a86836fc-9e35-4a35-be58-d4a43bfb9d2b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78882024-11-15T21:53:17.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4de69e1b-26c0-4532-8626-24a655297c91 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78892024-11-15T21:53:17.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4de69e1b-26c0-4532-8626-24a655297c91 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78902024-11-15T21:53:17.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4de69e1b-26c0-4532-8626-24a655297c91 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78912024-11-15T21:53:18.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9ecadaf-286a-40e9-aa84-05f7219dcf68 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78922024-11-15T21:53:18.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9ecadaf-286a-40e9-aa84-05f7219dcf68 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78932024-11-15T21:53:18.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9ecadaf-286a-40e9-aa84-05f7219dcf68 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78942024-11-15T21:53:19.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d44f23f3-8855-4b54-97a7-b0617f219dfa roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78952024-11-15T21:53:19.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d44f23f3-8855-4b54-97a7-b0617f219dfa resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78962024-11-15T21:53:19.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d44f23f3-8855-4b54-97a7-b0617f219dfa response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
78972024-11-15T21:53:20.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = b8237da8-49a2-49f5-8801-9b6002162496 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
78982024-11-15T21:53:20.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = b8237da8-49a2-49f5-8801-9b6002162496 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
78992024-11-15T21:53:20.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = b8237da8-49a2-49f5-8801-9b6002162496 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
79002024-11-15T21:53:20.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0f593951-97dd-442e-abd7-51fa093173c6 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
79012024-11-15T21:53:20.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0f593951-97dd-442e-abd7-51fa093173c6 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
79022024-11-15T21:53:20.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0f593951-97dd-442e-abd7-51fa093173c6 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
79032024-11-15T21:53:20.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 49cbd83c-5a44-407b-8ad2-1ac45aff842c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
79042024-11-15T21:53:20.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 49cbd83c-5a44-407b-8ad2-1ac45aff842c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
79052024-11-15T21:53:20.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 49cbd83c-5a44-407b-8ad2-1ac45aff842c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
79062024-11-15T21:53:21.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a210fa20-2ead-4815-a823-53fe629d9181 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
79072024-11-15T21:53:21.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a210fa20-2ead-4815-a823-53fe629d9181 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
79082024-11-15T21:53:21.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a210fa20-2ead-4815-a823-53fe629d9181 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
79092024-11-15T21:53:22.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 05e5cff0-34de-45ee-a628-7242f265be3d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
79102024-11-15T21:53:22.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 05e5cff0-34de-45ee-a628-7242f265be3d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
79112024-11-15T21:53:22.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 05e5cff0-34de-45ee-a628-7242f265be3d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
79122024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
79132024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
79142024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
79152024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
79162024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79172024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79182024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
79192024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
79202024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
79212024-11-15T21:53:23.052ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
79222024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
79232024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
79242024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79252024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79262024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
79272024-11-15T21:53:23.052ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
79282024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79292024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
79302024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
79312024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
79322024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
79332024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79342024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
79352024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79362024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79372024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
79382024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
79392024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
79402024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
79412024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
79422024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
79432024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
79442024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
79452024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79462024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79472024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
79482024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
79492024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79502024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79512024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
79522024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
79532024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79542024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
79552024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79562024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
79572024-11-15T21:53:23.052ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
79582024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
79592024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.4\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
79602024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
79612024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79622024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
79632024-11-15T21:53:23.052ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:43:23.052632139 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
79642024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79652024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
79662024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
79672024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
79682024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79692024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
79702024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
79712024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
79722024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79732024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79742024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79752024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79762024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79772024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79782024-11-15T21:53:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
79792024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79802024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79812024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79822024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
79832024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79842024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79852024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
79862024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79872024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79882024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
79892024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79902024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79912024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79922024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79932024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79942024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79952024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79962024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
79972024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
79982024-11-15T21:53:23.053ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1684, tv_nsec: 974135626 } })
79992024-11-15T21:53:23.053ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1684, tv_nsec: 974138916 } })
80002024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
80012024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.68676ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
80022024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
80032024-11-15T21:53:23.053ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.368769ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
80042024-11-15T21:53:23.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80052024-11-15T21:53:23.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80062024-11-15T21:53:23.056ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.182607ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80072024-11-15T21:53:23.056ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80082024-11-15T21:53:23.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80092024-11-15T21:53:23.058ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1684, tv_nsec: 979525481 } })
80102024-11-15T21:53:23.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80112024-11-15T21:53:23.059ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
80122024-11-15T21:53:23.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80132024-11-15T21:53:23.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80142024-11-15T21:53:23.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80152024-11-15T21:53:23.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
80162024-11-15T21:53:23.060ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80172024-11-15T21:53:23.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80182024-11-15T21:53:23.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80192024-11-15T21:53:23.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80202024-11-15T21:53:23.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80212024-11-15T21:53:23.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80222024-11-15T21:53:23.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80232024-11-15T21:53:23.063ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
80242024-11-15T21:53:23.063ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
80252024-11-15T21:53:23.063ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.581135ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
80262024-11-15T21:53:23.065ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.648582ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
80272024-11-15T21:53:23.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80282024-11-15T21:53:23.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80292024-11-15T21:53:23.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80302024-11-15T21:53:23.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80312024-11-15T21:53:23.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80322024-11-15T21:53:23.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80332024-11-15T21:53:23.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80342024-11-15T21:53:23.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80352024-11-15T21:53:23.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80362024-11-15T21:53:23.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80372024-11-15T21:53:23.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80382024-11-15T21:53:23.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80392024-11-15T21:53:23.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80402024-11-15T21:53:23.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80412024-11-15T21:53:23.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80422024-11-15T21:53:23.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80432024-11-15T21:53:23.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80442024-11-15T21:53:23.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80452024-11-15T21:53:23.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80462024-11-15T21:53:23.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80472024-11-15T21:53:23.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1684, tv_nsec: 993211240 } })
80482024-11-15T21:53:23.072ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80492024-11-15T21:53:23.072ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
80502024-11-15T21:53:23.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80512024-11-15T21:53:23.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80522024-11-15T21:53:23.074ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:43:23.052632139 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
80532024-11-15T21:53:23.074ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 22.067034ms iteration = 12 status = {"expiration":"2024-11-15T21:43:23.052632139Z","pruned":[]}
80542024-11-15T21:53:23.075ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80552024-11-15T21:53:23.075ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80562024-11-15T21:53:23.075ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80572024-11-15T21:53:23.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80582024-11-15T21:53:23.075ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80592024-11-15T21:53:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80602024-11-15T21:53:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80612024-11-15T21:53:23.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 24.053036ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
80622024-11-15T21:53:23.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80632024-11-15T21:53:23.078ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80642024-11-15T21:53:23.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80652024-11-15T21:53:23.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80662024-11-15T21:53:23.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80672024-11-15T21:53:23.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80682024-11-15T21:53:23.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80692024-11-15T21:53:23.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80702024-11-15T21:53:23.083ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.395658ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80712024-11-15T21:53:23.083ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1685, tv_nsec: 4133631 } })
80722024-11-15T21:53:23.083ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
80732024-11-15T21:53:23.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80742024-11-15T21:53:23.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80752024-11-15T21:53:23.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 32.744682ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80762024-11-15T21:53:23.090ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80772024-11-15T21:53:23.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80782024-11-15T21:53:23.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80792024-11-15T21:53:23.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80802024-11-15T21:53:23.093ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80812024-11-15T21:53:23.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
80822024-11-15T21:53:23.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80832024-11-15T21:53:23.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80842024-11-15T21:53:23.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80852024-11-15T21:53:23.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.881101ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
80862024-11-15T21:53:23.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
80872024-11-15T21:53:23.097ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80882024-11-15T21:53:23.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80892024-11-15T21:53:23.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80902024-11-15T21:53:23.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80912024-11-15T21:53:23.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80922024-11-15T21:53:23.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80932024-11-15T21:53:23.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80942024-11-15T21:53:23.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80952024-11-15T21:53:23.115ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
80962024-11-15T21:53:23.115ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.194361ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
80972024-11-15T21:53:23.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80982024-11-15T21:53:23.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
80992024-11-15T21:53:23.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81002024-11-15T21:53:23.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81012024-11-15T21:53:23.126ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81022024-11-15T21:53:23.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81032024-11-15T21:53:23.126ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
81042024-11-15T21:53:23.126ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
81052024-11-15T21:53:23.126ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.997811ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
81062024-11-15T21:53:23.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81072024-11-15T21:53:23.128ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 76.091304ms iteration = 23 status = 0
81082024-11-15T21:53:23.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81092024-11-15T21:53:23.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81102024-11-15T21:53:23.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81112024-11-15T21:53:23.140ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81122024-11-15T21:53:23.140ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81132024-11-15T21:53:23.140ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81142024-11-15T21:53:23.140ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81152024-11-15T21:53:23.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81162024-11-15T21:53:23.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81172024-11-15T21:53:23.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81182024-11-15T21:53:23.142ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81192024-11-15T21:53:23.142ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81202024-11-15T21:53:23.143ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81212024-11-15T21:53:23.143ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81222024-11-15T21:53:23.143ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.722848ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81232024-11-15T21:53:23.144ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
81242024-11-15T21:53:23.144ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
81252024-11-15T21:53:23.144ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
81262024-11-15T21:53:23.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81272024-11-15T21:53:23.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81282024-11-15T21:53:23.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81292024-11-15T21:53:23.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81302024-11-15T21:53:23.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81312024-11-15T21:53:23.145ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81322024-11-15T21:53:23.145ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.009444ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81332024-11-15T21:53:23.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81342024-11-15T21:53:23.145ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81352024-11-15T21:53:23.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81362024-11-15T21:53:23.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
81372024-11-15T21:53:23.146ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81382024-11-15T21:53:23.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81392024-11-15T21:53:23.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81402024-11-15T21:53:23.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81412024-11-15T21:53:23.150ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81422024-11-15T21:53:23.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81432024-11-15T21:53:23.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81442024-11-15T21:53:23.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81452024-11-15T21:53:23.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81462024-11-15T21:53:23.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81472024-11-15T21:53:23.155ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
81482024-11-15T21:53:23.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81492024-11-15T21:53:23.155ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
81502024-11-15T21:53:23.155ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
81512024-11-15T21:53:23.155ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81522024-11-15T21:53:23.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81532024-11-15T21:53:23.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81542024-11-15T21:53:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81552024-11-15T21:53:23.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81562024-11-15T21:53:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81572024-11-15T21:53:23.165ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
81582024-11-15T21:53:23.165ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
81592024-11-15T21:53:23.165ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
81602024-11-15T21:53:23.165ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 112.884393ms iteration = 13 status = {"generation":1}
81612024-11-15T21:53:23.167ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81622024-11-15T21:53:23.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81632024-11-15T21:53:23.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.306294ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
81642024-11-15T21:53:23.180ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
81652024-11-15T21:53:23.181ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
81662024-11-15T21:53:23.181ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
81672024-11-15T21:53:23.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81682024-11-15T21:53:23.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81692024-11-15T21:53:23.183ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81702024-11-15T21:53:23.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81712024-11-15T21:53:23.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81722024-11-15T21:53:23.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81732024-11-15T21:53:23.191ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
81742024-11-15T21:53:23.191ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 139.165874ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
81752024-11-15T21:53:23.193ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
81762024-11-15T21:53:23.193ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
81772024-11-15T21:53:23.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 147.152365ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
81782024-11-15T21:53:23.225ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
81792024-11-15T21:53:23.225ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
81802024-11-15T21:53:23.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81812024-11-15T21:53:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81822024-11-15T21:53:23.248ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
81832024-11-15T21:53:23.248ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81842024-11-15T21:53:23.248ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "380282f4-1d47-40d6-8330-d95dbcd5f351", "content-length": "26", "date": "Fri, 15 Nov 2024 21:53:22 GMT"} })
81852024-11-15T21:53:23.248ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81862024-11-15T21:53:23.250ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81872024-11-15T21:53:23.268ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
81882024-11-15T21:53:23.268ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81892024-11-15T21:53:23.269ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b8fb36a-27d1-4e21-9d6b-3fd57c6d8c57", "content-length": "26", "date": "Fri, 15 Nov 2024 21:53:22 GMT"} })
81902024-11-15T21:53:23.269ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81912024-11-15T21:53:23.271ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81922024-11-15T21:53:23.274ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 221.96525ms iteration = 27 status = {"physical_disks_added":0}
81932024-11-15T21:53:23.282ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
81942024-11-15T21:53:23.282ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 230.101904ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
81952024-11-15T21:53:23.290ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
81962024-11-15T21:53:23.290ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81972024-11-15T21:53:23.290ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23fa4fd6-39dc-4cd9-aa48-48005f5afead", "content-length": "26", "date": "Fri, 15 Nov 2024 21:53:22 GMT"} })
81982024-11-15T21:53:23.290ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81992024-11-15T21:53:23.291ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
82002024-11-15T21:53:23.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 1460ec76-532b-4ee5-b4e1-51d9acd76169 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
82012024-11-15T21:53:23.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 1460ec76-532b-4ee5-b4e1-51d9acd76169 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
82022024-11-15T21:53:23.440ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
82032024-11-15T21:53:23.440ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "00161549-11a0-46a6-a083-273a6dc2e980", "content-length": "1", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} })
82042024-11-15T21:53:23.443ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82052024-11-15T21:53:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82062024-11-15T21:53:23.466ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
82072024-11-15T21:53:23.466ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c4865a08-c37a-400e-a849-7a3572ac7879", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82082024-11-15T21:53:23.466ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82092024-11-15T21:53:23.468ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3715d1e5-7cea-420c-bdca-dd847f9f3417", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82102024-11-15T21:53:23.468ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82112024-11-15T21:53:23.470ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82122024-11-15T21:53:23.470ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 418.394896ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
82132024-11-15T21:53:23.482ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82142024-11-15T21:53:23.486ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "debbdb00-cbc3-493b-93db-6aff7d467eaf", "content-length": "691", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} })
82152024-11-15T21:53:23.486ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
82162024-11-15T21:53:23.486ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
82172024-11-15T21:53:23.486ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
82182024-11-15T21:53:23.488ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 435.791008ms iteration = 23 status = {}
82192024-11-15T21:53:23.514ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
82202024-11-15T21:53:23.530ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 478.646647ms iteration = 23 status = {}
82212024-11-15T21:53:23.536ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
82222024-11-15T21:53:23.536ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82232024-11-15T21:53:23.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffd38712-9b1d-4781-976f-53d5a9070be5", "content-length": "372", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} })
82242024-11-15T21:53:23.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82252024-11-15T21:53:23.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82262024-11-15T21:53:23.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82272024-11-15T21:53:23.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 1460ec76-532b-4ee5-b4e1-51d9acd76169 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
82282024-11-15T21:53:23.540ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 487.898597ms iteration = 23 status = null
82292024-11-15T21:53:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82302024-11-15T21:53:23.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82312024-11-15T21:53:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82322024-11-15T21:53:23.548ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
82332024-11-15T21:53:23.548ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
82342024-11-15T21:53:23.548ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
82352024-11-15T21:53:23.548ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 496.667444ms iteration = 13 status = {"generation":2}
82362024-11-15T21:53:23.587ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
82372024-11-15T21:53:23.587ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
82382024-11-15T21:53:23.588ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "90b419c0-b528-4e58-89f4-ef3aca4c2521", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} })
82392024-11-15T21:53:23.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82402024-11-15T21:53:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82412024-11-15T21:53:23.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82422024-11-15T21:53:23.591ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
82432024-11-15T21:53:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82442024-11-15T21:53:23.591ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8da16f45-589b-4e32-beca-ac218e0b531c", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82452024-11-15T21:53:23.591ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82462024-11-15T21:53:23.592ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c6af4a80-58ca-4ffe-9277-ef59d76b0e38", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82472024-11-15T21:53:23.592ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82482024-11-15T21:53:23.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82492024-11-15T21:53:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82502024-11-15T21:53:23.594ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ee4eb249-e7e6-4b8e-a1ed-90a075c55992", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82512024-11-15T21:53:23.594ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82522024-11-15T21:53:23.596ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82532024-11-15T21:53:23.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 544.524975ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
82542024-11-15T21:53:23.598ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
82552024-11-15T21:53:23.598ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82562024-11-15T21:53:23.598ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e16b2f2a-2017-48c9-b110-f50389b6d618", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} })
82572024-11-15T21:53:23.600ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 547.929967ms iteration = 24 status = {}
82582024-11-15T21:53:23.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82592024-11-15T21:53:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82602024-11-15T21:53:23.627ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
82612024-11-15T21:53:23.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82622024-11-15T21:53:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82632024-11-15T21:53:23.639ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
82642024-11-15T21:53:23.639ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1670582a-c7b6-4b7d-8b6b-990a25f11df6", "content-length": "134", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} })
82652024-11-15T21:53:23.639ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
82662024-11-15T21:53:23.639ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
82672024-11-15T21:53:23.640ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
82682024-11-15T21:53:23.640ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82692024-11-15T21:53:23.640ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82702024-11-15T21:53:23.640ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82712024-11-15T21:53:23.640ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82722024-11-15T21:53:23.640ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82732024-11-15T21:53:23.640ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82742024-11-15T21:53:23.640ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82752024-11-15T21:53:23.640ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
82762024-11-15T21:53:23.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82772024-11-15T21:53:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82782024-11-15T21:53:23.642ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82792024-11-15T21:53:23.642ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c6931c7-e709-4853-8236-cbe4df05b84a", "content-length": "2", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} })
82802024-11-15T21:53:23.642ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82812024-11-15T21:53:23.642ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f952406-480c-4994-8b09-9a7c06c22d53", "content-length": "52", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} })
82822024-11-15T21:53:23.642ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
82832024-11-15T21:53:23.642ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82842024-11-15T21:53:23.744ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "50405b3e-94ea-4ed1-b3c0-fc4474be9c42", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} })
82852024-11-15T21:53:23.745ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
82862024-11-15T21:53:23.745ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82872024-11-15T21:53:23.745ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "840e314b-ea1d-454b-8f49-282807a91f1b", "content-length": "682", "date": "Fri, 15 Nov 2024 21:53:23 GMT"} })
82882024-11-15T21:53:23.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82892024-11-15T21:53:23.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82902024-11-15T21:53:23.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82912024-11-15T21:53:23.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82922024-11-15T21:53:23.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82932024-11-15T21:53:23.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82942024-11-15T21:53:23.754ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82952024-11-15T21:53:23.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82962024-11-15T21:53:23.760ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 708.564798ms iteration = 23 status = {}
82972024-11-15T21:53:23.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 96fa5de5-f427-40b1-9cf1-76fd2b8b946b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
82982024-11-15T21:53:23.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 96fa5de5-f427-40b1-9cf1-76fd2b8b946b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
82992024-11-15T21:53:23.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 96fa5de5-f427-40b1-9cf1-76fd2b8b946b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83002024-11-15T21:53:25.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c22b8974-06ed-46a8-9a9f-3df5084d6287 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83012024-11-15T21:53:25.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c22b8974-06ed-46a8-9a9f-3df5084d6287 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83022024-11-15T21:53:25.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c22b8974-06ed-46a8-9a9f-3df5084d6287 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83032024-11-15T21:53:26.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 51024752-fb67-4c78-8f8f-8dc61099e05d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83042024-11-15T21:53:26.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 51024752-fb67-4c78-8f8f-8dc61099e05d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83052024-11-15T21:53:26.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 51024752-fb67-4c78-8f8f-8dc61099e05d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83062024-11-15T21:53:27.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = af2adab3-4bc1-4a1d-b8f4-7448867ed67b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83072024-11-15T21:53:27.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = af2adab3-4bc1-4a1d-b8f4-7448867ed67b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83082024-11-15T21:53:27.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = af2adab3-4bc1-4a1d-b8f4-7448867ed67b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83092024-11-15T21:53:28.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9344dab-1404-45f3-b55b-1de5c04c54ed roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83102024-11-15T21:53:28.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9344dab-1404-45f3-b55b-1de5c04c54ed resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83112024-11-15T21:53:28.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9344dab-1404-45f3-b55b-1de5c04c54ed response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83122024-11-15T21:53:28.733ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:48577
83132024-11-15T21:53:28.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48577 req_id = ca61ecec-e941-4e74-b679-f71d02aa51a4 roles = RoleSet { roles: {} } uri = /metrics/producers
83142024-11-15T21:53:28.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48577 req_id = ca61ecec-e941-4e74-b679-f71d02aa51a4 resource = Database result = Ok(()) uri = /metrics/producers
83152024-11-15T21:53:28.772ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 54270a8d-942f-4159-a4b4-d6745626c749
83162024-11-15T21:53:28.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38594 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48577 req_id = ca61ecec-e941-4e74-b679-f71d02aa51a4 response_code = 201 uri = /metrics/producers
83172024-11-15T21:53:29.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d12f1d27-edee-42bf-8944-63830e10bc02 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83182024-11-15T21:53:29.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d12f1d27-edee-42bf-8944-63830e10bc02 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83192024-11-15T21:53:29.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d12f1d27-edee-42bf-8944-63830e10bc02 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83202024-11-15T21:53:30.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 18d2e2b4-cebf-4ae5-ae5c-f6b63effde5a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83212024-11-15T21:53:30.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 18d2e2b4-cebf-4ae5-ae5c-f6b63effde5a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83222024-11-15T21:53:30.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 18d2e2b4-cebf-4ae5-ae5c-f6b63effde5a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83232024-11-15T21:53:30.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1294 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 48ef5a5a-4c57-403e-8efc-48d1d13c76dd response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
83242024-11-15T21:53:31.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 890831bd-8501-4425-8ad5-64230fe046f0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83252024-11-15T21:53:31.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 890831bd-8501-4425-8ad5-64230fe046f0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83262024-11-15T21:53:31.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 890831bd-8501-4425-8ad5-64230fe046f0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83272024-11-15T21:53:32.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7791aed-c878-4bc8-b198-5c423866dda1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83282024-11-15T21:53:32.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7791aed-c878-4bc8-b198-5c423866dda1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83292024-11-15T21:53:32.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7791aed-c878-4bc8-b198-5c423866dda1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83302024-11-15T21:53:33.040ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
83312024-11-15T21:53:33.040ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
83322024-11-15T21:53:33.040ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83332024-11-15T21:53:33.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83342024-11-15T21:53:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83352024-11-15T21:53:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83362024-11-15T21:53:33.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83372024-11-15T21:53:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83382024-11-15T21:53:33.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83392024-11-15T21:53:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83402024-11-15T21:53:33.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83412024-11-15T21:53:33.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83422024-11-15T21:53:33.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83432024-11-15T21:53:33.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
83442024-11-15T21:53:33.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83452024-11-15T21:53:33.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83462024-11-15T21:53:33.063ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
83472024-11-15T21:53:33.063ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.873508ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
83482024-11-15T21:53:33.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83492024-11-15T21:53:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83502024-11-15T21:53:33.101ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.964535ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83512024-11-15T21:53:33.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f100ea33-3444-43fd-9560-1298ca451bd8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83522024-11-15T21:53:33.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f100ea33-3444-43fd-9560-1298ca451bd8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83532024-11-15T21:53:33.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f100ea33-3444-43fd-9560-1298ca451bd8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83542024-11-15T21:53:34.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14de3a8c-b4c9-481e-b8cd-71f8e1c8eb47 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83552024-11-15T21:53:34.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14de3a8c-b4c9-481e-b8cd-71f8e1c8eb47 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83562024-11-15T21:53:34.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14de3a8c-b4c9-481e-b8cd-71f8e1c8eb47 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83572024-11-15T21:53:35.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ee779a05-893a-4343-a04c-896027759af0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83582024-11-15T21:53:35.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ee779a05-893a-4343-a04c-896027759af0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83592024-11-15T21:53:35.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ee779a05-893a-4343-a04c-896027759af0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83602024-11-15T21:53:35.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0c81782a-50a2-4e7e-98c3-6cf2fe538059 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
83612024-11-15T21:53:35.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0c81782a-50a2-4e7e-98c3-6cf2fe538059 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
83622024-11-15T21:53:35.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0c81782a-50a2-4e7e-98c3-6cf2fe538059 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
83632024-11-15T21:53:35.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d36abb1d-0ec7-4087-846b-e1635d12b258 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
83642024-11-15T21:53:35.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d36abb1d-0ec7-4087-846b-e1635d12b258 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
83652024-11-15T21:53:35.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = d36abb1d-0ec7-4087-846b-e1635d12b258 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
83662024-11-15T21:53:36.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a27e9528-4cb2-442c-bf9e-cb987d3076d8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83672024-11-15T21:53:36.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a27e9528-4cb2-442c-bf9e-cb987d3076d8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83682024-11-15T21:53:36.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a27e9528-4cb2-442c-bf9e-cb987d3076d8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83692024-11-15T21:53:37.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c9d2b8e1-2a8c-4341-a864-268f51046591 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83702024-11-15T21:53:37.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c9d2b8e1-2a8c-4341-a864-268f51046591 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83712024-11-15T21:53:37.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c9d2b8e1-2a8c-4341-a864-268f51046591 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83722024-11-15T21:53:38.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a0f35525-8603-4e34-8c2c-90c991fe0892 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83732024-11-15T21:53:38.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a0f35525-8603-4e34-8c2c-90c991fe0892 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83742024-11-15T21:53:38.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a0f35525-8603-4e34-8c2c-90c991fe0892 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83752024-11-15T21:53:39.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4e6499cf-a9ed-437a-a30c-580f1d4baf16 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83762024-11-15T21:53:39.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4e6499cf-a9ed-437a-a30c-580f1d4baf16 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83772024-11-15T21:53:39.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4e6499cf-a9ed-437a-a30c-580f1d4baf16 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83782024-11-15T21:53:40.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 615ea666-b290-4d26-8285-62ad66ca532a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83792024-11-15T21:53:40.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 615ea666-b290-4d26-8285-62ad66ca532a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83802024-11-15T21:53:40.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 615ea666-b290-4d26-8285-62ad66ca532a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83812024-11-15T21:53:41.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3db266a7-ab19-4d51-8c85-227fa8227a10 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83822024-11-15T21:53:41.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3db266a7-ab19-4d51-8c85-227fa8227a10 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83832024-11-15T21:53:41.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3db266a7-ab19-4d51-8c85-227fa8227a10 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83842024-11-15T21:53:42.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e978f49a-7195-47c2-98a1-be2187928216 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83852024-11-15T21:53:42.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e978f49a-7195-47c2-98a1-be2187928216 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83862024-11-15T21:53:42.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e978f49a-7195-47c2-98a1-be2187928216 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
83872024-11-15T21:53:43.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
83882024-11-15T21:53:43.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
83892024-11-15T21:53:43.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83902024-11-15T21:53:43.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83912024-11-15T21:53:43.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83922024-11-15T21:53:43.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83932024-11-15T21:53:43.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83942024-11-15T21:53:43.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83952024-11-15T21:53:43.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83962024-11-15T21:53:43.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83972024-11-15T21:53:43.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83982024-11-15T21:53:43.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83992024-11-15T21:53:43.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84002024-11-15T21:53:43.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
84012024-11-15T21:53:43.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84022024-11-15T21:53:43.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84032024-11-15T21:53:43.059ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
84042024-11-15T21:53:43.059ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.376385ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
84052024-11-15T21:53:43.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84062024-11-15T21:53:43.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84072024-11-15T21:53:43.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.89541ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84082024-11-15T21:53:43.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cbb6610f-0e6d-4950-8862-7355c994ed0f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84092024-11-15T21:53:43.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cbb6610f-0e6d-4950-8862-7355c994ed0f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84102024-11-15T21:53:43.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cbb6610f-0e6d-4950-8862-7355c994ed0f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84112024-11-15T21:53:44.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a48cd75a-9da2-4f1f-8dd1-b35ef3f33e43 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84122024-11-15T21:53:44.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a48cd75a-9da2-4f1f-8dd1-b35ef3f33e43 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84132024-11-15T21:53:44.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a48cd75a-9da2-4f1f-8dd1-b35ef3f33e43 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84142024-11-15T21:53:45.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1637a108-9a2b-4538-b9dd-e6f7945588dc roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84152024-11-15T21:53:45.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1637a108-9a2b-4538-b9dd-e6f7945588dc resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84162024-11-15T21:53:45.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1637a108-9a2b-4538-b9dd-e6f7945588dc response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84172024-11-15T21:53:45.676ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 24874db3-ea81-4216-bce6-8b1f90b40bff response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
84182024-11-15T21:53:46.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3674768-e408-4db9-b6d5-f6823858e5bb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84192024-11-15T21:53:46.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3674768-e408-4db9-b6d5-f6823858e5bb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84202024-11-15T21:53:46.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3674768-e408-4db9-b6d5-f6823858e5bb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84212024-11-15T21:53:47.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d15ed3e5-1f8c-48ae-a132-22de4cb5cfd0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84222024-11-15T21:53:47.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d15ed3e5-1f8c-48ae-a132-22de4cb5cfd0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84232024-11-15T21:53:47.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d15ed3e5-1f8c-48ae-a132-22de4cb5cfd0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84242024-11-15T21:53:48.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac3f171c-907e-4383-bbd0-109b9f47f393 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84252024-11-15T21:53:48.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac3f171c-907e-4383-bbd0-109b9f47f393 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84262024-11-15T21:53:48.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ac3f171c-907e-4383-bbd0-109b9f47f393 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84272024-11-15T21:53:49.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 76cc8cbb-717d-4305-ad7a-77d363cdbb50 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84282024-11-15T21:53:49.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 76cc8cbb-717d-4305-ad7a-77d363cdbb50 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84292024-11-15T21:53:49.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 76cc8cbb-717d-4305-ad7a-77d363cdbb50 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84302024-11-15T21:53:50.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 907ccad3-2651-42fc-9774-c2ef0104813a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84312024-11-15T21:53:50.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 907ccad3-2651-42fc-9774-c2ef0104813a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84322024-11-15T21:53:50.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 907ccad3-2651-42fc-9774-c2ef0104813a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84332024-11-15T21:53:51.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14200599-1ced-4532-ad7f-30df91526954 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84342024-11-15T21:53:51.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14200599-1ced-4532-ad7f-30df91526954 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84352024-11-15T21:53:51.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14200599-1ced-4532-ad7f-30df91526954 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84362024-11-15T21:53:52.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3433305b-39b0-4aa3-bc2d-4931f1ddf3e6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84372024-11-15T21:53:52.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3433305b-39b0-4aa3-bc2d-4931f1ddf3e6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84382024-11-15T21:53:52.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3433305b-39b0-4aa3-bc2d-4931f1ddf3e6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
84392024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
84402024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
84412024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84422024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
84432024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
84442024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84452024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84462024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84472024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
84482024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84492024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
84502024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
84512024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84522024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84532024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
84542024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
84552024-11-15T21:53:53.035ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84562024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84572024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84582024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
84592024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84602024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
84612024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
84622024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
84632024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84642024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
84652024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84662024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
84672024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84682024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
84692024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84702024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
84712024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84722024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
84732024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84742024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84752024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84762024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84772024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84782024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84792024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84802024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84812024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84822024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84832024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84842024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84852024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84862024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84872024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84882024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84892024-11-15T21:53:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84902024-11-15T21:53:53.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84912024-11-15T21:53:53.038ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.545773ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84922024-11-15T21:53:53.039ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84932024-11-15T21:53:53.039ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84942024-11-15T21:53:53.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84952024-11-15T21:53:53.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84962024-11-15T21:53:53.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84972024-11-15T21:53:53.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84982024-11-15T21:53:53.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84992024-11-15T21:53:53.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85002024-11-15T21:53:53.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85012024-11-15T21:53:53.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85022024-11-15T21:53:53.047ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1714, tv_nsec: 986087852 } })
85032024-11-15T21:53:53.047ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
85042024-11-15T21:53:53.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85052024-11-15T21:53:53.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85062024-11-15T21:53:53.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85072024-11-15T21:53:53.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1714, tv_nsec: 990020367 } })
85082024-11-15T21:53:53.051ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
85092024-11-15T21:53:53.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85102024-11-15T21:53:53.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85112024-11-15T21:53:53.060ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1714, tv_nsec: 999136616 } })
85122024-11-15T21:53:53.061ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
85132024-11-15T21:53:53.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85142024-11-15T21:53:53.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85152024-11-15T21:53:53.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85162024-11-15T21:53:53.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85172024-11-15T21:53:53.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85182024-11-15T21:53:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85192024-11-15T21:53:53.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85202024-11-15T21:53:53.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85212024-11-15T21:53:53.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.843197ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
85222024-11-15T21:53:53.087ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85232024-11-15T21:53:53.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85242024-11-15T21:53:53.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85252024-11-15T21:53:53.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85262024-11-15T21:53:53.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
85272024-11-15T21:53:53.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85282024-11-15T21:53:53.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85292024-11-15T21:53:53.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85302024-11-15T21:53:53.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85312024-11-15T21:53:53.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85322024-11-15T21:53:53.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85332024-11-15T21:53:53.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85342024-11-15T21:53:53.098ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85352024-11-15T21:53:53.098ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85362024-11-15T21:53:53.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85372024-11-15T21:53:53.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85382024-11-15T21:53:53.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85392024-11-15T21:53:53.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85402024-11-15T21:53:53.099ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85412024-11-15T21:53:53.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85422024-11-15T21:53:53.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85432024-11-15T21:53:53.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85442024-11-15T21:53:53.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85452024-11-15T21:53:53.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85462024-11-15T21:53:53.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.124095ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85472024-11-15T21:53:53.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85482024-11-15T21:53:53.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85492024-11-15T21:53:53.103ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85502024-11-15T21:53:53.103ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85512024-11-15T21:53:53.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85522024-11-15T21:53:53.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85532024-11-15T21:53:53.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85542024-11-15T21:53:53.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85552024-11-15T21:53:53.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
85562024-11-15T21:53:53.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85572024-11-15T21:53:53.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85582024-11-15T21:53:53.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85592024-11-15T21:53:53.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85602024-11-15T21:53:53.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85612024-11-15T21:53:53.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
85622024-11-15T21:53:53.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.207939ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
85632024-11-15T21:53:53.108ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 73.111805ms iteration = 24 status = 0
85642024-11-15T21:53:53.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85652024-11-15T21:53:53.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85662024-11-15T21:53:53.110ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85672024-11-15T21:53:53.110ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.707902ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
85682024-11-15T21:53:53.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85692024-11-15T21:53:53.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85702024-11-15T21:53:53.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.019287ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85712024-11-15T21:53:53.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85722024-11-15T21:53:53.133ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
85732024-11-15T21:53:53.133ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85742024-11-15T21:53:53.133ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85752024-11-15T21:53:53.133ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85762024-11-15T21:53:53.133ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.784722ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85772024-11-15T21:53:53.133ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e072a915-4414-4649-9aec-eb12353b110b", "content-length": "26", "date": "Fri, 15 Nov 2024 21:53:52 GMT"} })
85782024-11-15T21:53:53.134ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85792024-11-15T21:53:53.135ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85802024-11-15T21:53:53.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.706243ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
85812024-11-15T21:53:53.139ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.052806ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
85822024-11-15T21:53:53.139ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
85832024-11-15T21:53:53.139ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85842024-11-15T21:53:53.139ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "35e7a166-8c76-45c6-b903-0ae01dc0c652", "content-length": "26", "date": "Fri, 15 Nov 2024 21:53:52 GMT"} })
85852024-11-15T21:53:53.139ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85862024-11-15T21:53:53.141ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85872024-11-15T21:53:53.141ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.518802ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85882024-11-15T21:53:53.141ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85892024-11-15T21:53:53.152ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
85902024-11-15T21:53:53.152ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85912024-11-15T21:53:53.152ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "385d28eb-3a2a-4816-8470-bc4a30dbfe65", "content-length": "26", "date": "Fri, 15 Nov 2024 21:53:52 GMT"} })
85922024-11-15T21:53:53.152ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85932024-11-15T21:53:53.154ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
85942024-11-15T21:53:53.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85952024-11-15T21:53:53.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85962024-11-15T21:53:53.226ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.339102ms iteration = 28 status = {"physical_disks_added":0}
85972024-11-15T21:53:53.227ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85982024-11-15T21:53:53.227ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "261a3a37-f3ab-4313-9ab5-d1abbabee2c0", "content-length": "1", "date": "Fri, 15 Nov 2024 21:53:52 GMT"} })
85992024-11-15T21:53:53.229ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86002024-11-15T21:53:53.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86012024-11-15T21:53:53.231ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 196.565056ms iteration = 24 status = null
86022024-11-15T21:53:53.233ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 198.495889ms iteration = 24 status = {}
86032024-11-15T21:53:53.245ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86042024-11-15T21:53:53.245ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86052024-11-15T21:53:53.254ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dc9f6bc-782a-4c39-9f35-95ee1794b29f", "content-length": "372", "date": "Fri, 15 Nov 2024 21:53:53 GMT"} })
86062024-11-15T21:53:53.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86072024-11-15T21:53:53.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86082024-11-15T21:53:53.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86092024-11-15T21:53:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86102024-11-15T21:53:53.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86112024-11-15T21:53:53.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86122024-11-15T21:53:53.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86132024-11-15T21:53:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86142024-11-15T21:53:53.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86152024-11-15T21:53:53.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86162024-11-15T21:53:53.285ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86172024-11-15T21:53:53.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86182024-11-15T21:53:53.296ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
86192024-11-15T21:53:53.296ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86202024-11-15T21:53:53.297ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "35b3abf0-4c03-4201-8c7a-85097da78e3b", "date": "Fri, 15 Nov 2024 21:53:52 GMT"} })
86212024-11-15T21:53:53.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86222024-11-15T21:53:53.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86232024-11-15T21:53:53.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86242024-11-15T21:53:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86252024-11-15T21:53:53.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86262024-11-15T21:53:53.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86272024-11-15T21:53:53.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86282024-11-15T21:53:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86292024-11-15T21:53:53.306ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
86302024-11-15T21:53:53.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86312024-11-15T21:53:53.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86322024-11-15T21:53:53.310ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
86332024-11-15T21:53:53.310ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86342024-11-15T21:53:53.313ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ed98f0a9-6f3f-42ae-9287-1fa0cfa02e25", "date": "Fri, 15 Nov 2024 21:53:52 GMT"} })
86352024-11-15T21:53:53.315ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 280.492431ms iteration = 25 status = {}
86362024-11-15T21:53:53.319ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
86372024-11-15T21:53:53.319ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b2b452d-2f18-4359-ad0d-64affb28ad60", "content-length": "134", "date": "Fri, 15 Nov 2024 21:53:52 GMT"} })
86382024-11-15T21:53:53.319ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
86392024-11-15T21:53:53.319ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
86402024-11-15T21:53:53.320ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
86412024-11-15T21:53:53.320ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86422024-11-15T21:53:53.320ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86432024-11-15T21:53:53.320ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86442024-11-15T21:53:53.320ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86452024-11-15T21:53:53.320ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86462024-11-15T21:53:53.320ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86472024-11-15T21:53:53.320ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86482024-11-15T21:53:53.320ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
86492024-11-15T21:53:53.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86502024-11-15T21:53:53.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86512024-11-15T21:53:53.323ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86522024-11-15T21:53:53.323ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d649c80-c9b5-4695-b339-3659b3fe3af8", "content-length": "2", "date": "Fri, 15 Nov 2024 21:53:52 GMT"} })
86532024-11-15T21:53:53.323ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86542024-11-15T21:53:53.323ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f1755bc-36f7-4634-8e2e-f82622fa190c", "content-length": "52", "date": "Fri, 15 Nov 2024 21:53:52 GMT"} })
86552024-11-15T21:53:53.323ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
86562024-11-15T21:53:53.323ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86572024-11-15T21:53:53.395ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86582024-11-15T21:53:53.396ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5907408-5b0d-4c0f-8c35-801abcba4bbc", "content-length": "691", "date": "Fri, 15 Nov 2024 21:53:52 GMT"} })
86592024-11-15T21:53:53.396ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
86602024-11-15T21:53:53.396ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
86612024-11-15T21:53:53.396ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
86622024-11-15T21:53:53.399ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 364.016882ms iteration = 24 status = {}
86632024-11-15T21:53:53.552ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9d3db7dc-cf29-4d32-b56f-d2490616e8ac", "date": "Fri, 15 Nov 2024 21:53:53 GMT"} })
86642024-11-15T21:53:53.552ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
86652024-11-15T21:53:53.552ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86662024-11-15T21:53:53.552ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "652a8dd3-841b-45dd-9c74-1ba456a53935", "content-length": "682", "date": "Fri, 15 Nov 2024 21:53:53 GMT"} })
86672024-11-15T21:53:53.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86682024-11-15T21:53:53.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86692024-11-15T21:53:53.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = edb9f98c-932e-4317-b552-bd6b28f70857 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
86702024-11-15T21:53:53.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = edb9f98c-932e-4317-b552-bd6b28f70857 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
86712024-11-15T21:53:53.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86722024-11-15T21:53:53.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86732024-11-15T21:53:53.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = edb9f98c-932e-4317-b552-bd6b28f70857 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
86742024-11-15T21:53:53.561ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86752024-11-15T21:53:53.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86762024-11-15T21:53:53.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86772024-11-15T21:53:53.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86782024-11-15T21:53:53.574ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 539.608762ms iteration = 24 status = {}
86792024-11-15T21:53:53.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 38ff03c3-510d-4b2f-85f2-420616097baa roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86802024-11-15T21:53:53.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 38ff03c3-510d-4b2f-85f2-420616097baa resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86812024-11-15T21:53:53.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 38ff03c3-510d-4b2f-85f2-420616097baa response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86822024-11-15T21:53:54.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 28110cee-d032-4bf6-88ae-a2de161190cb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86832024-11-15T21:53:54.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 28110cee-d032-4bf6-88ae-a2de161190cb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86842024-11-15T21:53:54.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 28110cee-d032-4bf6-88ae-a2de161190cb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86852024-11-15T21:53:55.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a3ca95d3-587c-4d07-9c79-f1fc0c762e2e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86862024-11-15T21:53:55.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a3ca95d3-587c-4d07-9c79-f1fc0c762e2e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86872024-11-15T21:53:55.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a3ca95d3-587c-4d07-9c79-f1fc0c762e2e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86882024-11-15T21:53:56.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ffa5df27-b944-4914-966e-ef3fa1c73f4f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86892024-11-15T21:53:56.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ffa5df27-b944-4914-966e-ef3fa1c73f4f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86902024-11-15T21:53:56.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ffa5df27-b944-4914-966e-ef3fa1c73f4f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86912024-11-15T21:53:57.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 959059e9-155c-46e4-a6bc-5f055f2dfe3a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86922024-11-15T21:53:57.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 959059e9-155c-46e4-a6bc-5f055f2dfe3a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86932024-11-15T21:53:57.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 959059e9-155c-46e4-a6bc-5f055f2dfe3a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86942024-11-15T21:53:58.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6b3ba4a2-3e5e-4b46-85a7-7e537fdc3b5a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86952024-11-15T21:53:58.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6b3ba4a2-3e5e-4b46-85a7-7e537fdc3b5a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86962024-11-15T21:53:58.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6b3ba4a2-3e5e-4b46-85a7-7e537fdc3b5a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86972024-11-15T21:53:59.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad75bd75-86cd-4d87-8621-32123d5a42f3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86982024-11-15T21:53:59.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad75bd75-86cd-4d87-8621-32123d5a42f3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
86992024-11-15T21:53:59.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad75bd75-86cd-4d87-8621-32123d5a42f3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87002024-11-15T21:54:00.675ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1295 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = c08303b7-319a-4ff4-9bf1-8998dd6bbf25 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
87012024-11-15T21:54:00.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a98532f3-8c76-4926-8d8c-616a5352dd16 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87022024-11-15T21:54:00.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a98532f3-8c76-4926-8d8c-616a5352dd16 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87032024-11-15T21:54:00.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a98532f3-8c76-4926-8d8c-616a5352dd16 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87042024-11-15T21:54:01.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 91629bf7-cd43-49f2-a9c9-cf4820f5ab07 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87052024-11-15T21:54:01.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 91629bf7-cd43-49f2-a9c9-cf4820f5ab07 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87062024-11-15T21:54:01.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 91629bf7-cd43-49f2-a9c9-cf4820f5ab07 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87072024-11-15T21:54:02.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 24e4db0b-b5db-4154-a3e3-9ff7bd97c980 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
87082024-11-15T21:54:02.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 24e4db0b-b5db-4154-a3e3-9ff7bd97c980 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
87092024-11-15T21:54:02.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 24e4db0b-b5db-4154-a3e3-9ff7bd97c980 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
87102024-11-15T21:54:02.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = f88490aa-c62b-4040-9698-5a4553281b52 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
87112024-11-15T21:54:02.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = f88490aa-c62b-4040-9698-5a4553281b52 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
87122024-11-15T21:54:02.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = f88490aa-c62b-4040-9698-5a4553281b52 response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
87132024-11-15T21:54:02.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 98a7233e-76e1-4d5e-a3e8-f3de160d26e7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87142024-11-15T21:54:02.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 98a7233e-76e1-4d5e-a3e8-f3de160d26e7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87152024-11-15T21:54:02.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 98a7233e-76e1-4d5e-a3e8-f3de160d26e7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87162024-11-15T21:54:03.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
87172024-11-15T21:54:03.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87182024-11-15T21:54:03.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
87192024-11-15T21:54:03.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87202024-11-15T21:54:03.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87212024-11-15T21:54:03.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87222024-11-15T21:54:03.037ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87232024-11-15T21:54:03.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87242024-11-15T21:54:03.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87252024-11-15T21:54:03.040ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.015909ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87262024-11-15T21:54:03.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87272024-11-15T21:54:03.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87282024-11-15T21:54:03.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87292024-11-15T21:54:03.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87302024-11-15T21:54:03.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87312024-11-15T21:54:03.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87322024-11-15T21:54:03.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
87332024-11-15T21:54:03.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87342024-11-15T21:54:03.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87352024-11-15T21:54:03.069ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
87362024-11-15T21:54:03.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.207358ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
87372024-11-15T21:54:03.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 930e81ad-18be-4aec-ae9d-92f71bdbb1a0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87382024-11-15T21:54:03.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 930e81ad-18be-4aec-ae9d-92f71bdbb1a0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87392024-11-15T21:54:03.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 930e81ad-18be-4aec-ae9d-92f71bdbb1a0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87402024-11-15T21:54:04.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8242d44f-dac8-4031-86e7-2c702816705b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87412024-11-15T21:54:04.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8242d44f-dac8-4031-86e7-2c702816705b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87422024-11-15T21:54:04.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8242d44f-dac8-4031-86e7-2c702816705b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87432024-11-15T21:54:05.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 4fccdc15-3249-41d7-9676-1650617531dd roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
87442024-11-15T21:54:05.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 4fccdc15-3249-41d7-9676-1650617531dd resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
87452024-11-15T21:54:05.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 4fccdc15-3249-41d7-9676-1650617531dd response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
87462024-11-15T21:54:05.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 6db873d2-330c-4ca0-81a7-eeb681668c10 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
87472024-11-15T21:54:05.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 6db873d2-330c-4ca0-81a7-eeb681668c10 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
87482024-11-15T21:54:05.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 6db873d2-330c-4ca0-81a7-eeb681668c10 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
87492024-11-15T21:54:05.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5328182b-f43e-49b1-8678-fbf0927ef13c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87502024-11-15T21:54:05.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5328182b-f43e-49b1-8678-fbf0927ef13c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87512024-11-15T21:54:05.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5328182b-f43e-49b1-8678-fbf0927ef13c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87522024-11-15T21:54:06.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fd5b27ab-a3cf-447d-a55f-bc87adf5af4a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87532024-11-15T21:54:06.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fd5b27ab-a3cf-447d-a55f-bc87adf5af4a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87542024-11-15T21:54:06.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fd5b27ab-a3cf-447d-a55f-bc87adf5af4a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87552024-11-15T21:54:08.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 47a1fe0d-e2eb-472d-9eef-908b5f5788ec roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87562024-11-15T21:54:08.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 47a1fe0d-e2eb-472d-9eef-908b5f5788ec resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87572024-11-15T21:54:08.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 47a1fe0d-e2eb-472d-9eef-908b5f5788ec response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87582024-11-15T21:54:09.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b9321f80-aabf-45fb-9cc5-dfbd9f7a141c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87592024-11-15T21:54:09.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b9321f80-aabf-45fb-9cc5-dfbd9f7a141c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87602024-11-15T21:54:09.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b9321f80-aabf-45fb-9cc5-dfbd9f7a141c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87612024-11-15T21:54:10.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 38ab4b3c-d068-4134-a2f2-b3285bd27713 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87622024-11-15T21:54:10.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 38ab4b3c-d068-4134-a2f2-b3285bd27713 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87632024-11-15T21:54:10.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 38ab4b3c-d068-4134-a2f2-b3285bd27713 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87642024-11-15T21:54:10.089ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1a63a07c-70cd-4d34-a7b8-3b73abdee54d uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-15T21:54:10.087016912Z }
87652024-11-15T21:54:10.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1a63a07c-70cd-4d34-a7b8-3b73abdee54d roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
87662024-11-15T21:54:10.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1a63a07c-70cd-4d34-a7b8-3b73abdee54d resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
87672024-11-15T21:54:10.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13216 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1a63a07c-70cd-4d34-a7b8-3b73abdee54d response_code = 204 uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
87682024-11-15T21:54:10.100ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 52cbaa67-5c62-4709-b8a3-042324174356 uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-15T21:54:10.100852622Z }
87692024-11-15T21:54:10.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 52cbaa67-5c62-4709-b8a3-042324174356 roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
87702024-11-15T21:54:10.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 52cbaa67-5c62-4709-b8a3-042324174356 resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
87712024-11-15T21:54:10.121ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:51282
87722024-11-15T21:54:10.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:51282 req_id = c8a68234-7d1c-4703-ade0-3854359b7067 roles = RoleSet { roles: {} } uri = /metrics/producers
87732024-11-15T21:54:10.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:51282 req_id = c8a68234-7d1c-4703-ade0-3854359b7067 resource = Database result = Ok(()) uri = /metrics/producers
87742024-11-15T21:54:10.130ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = db5a96e5-953b-4a42-9728-0596f28327ba
87752024-11-15T21:54:10.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8514 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:51282 req_id = c8a68234-7d1c-4703-ade0-3854359b7067 response_code = 201 uri = /metrics/producers
87762024-11-15T21:54:10.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35573 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 52cbaa67-5c62-4709-b8a3-042324174356 response_code = 204 uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
87772024-11-15T21:54:11.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = abd8d8ab-5dd0-4c5b-9618-4bee80d8adfd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87782024-11-15T21:54:11.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = abd8d8ab-5dd0-4c5b-9618-4bee80d8adfd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87792024-11-15T21:54:11.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = abd8d8ab-5dd0-4c5b-9618-4bee80d8adfd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87802024-11-15T21:54:12.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6c6b232-4abd-4e88-932d-997501adc0e9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87812024-11-15T21:54:12.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6c6b232-4abd-4e88-932d-997501adc0e9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87822024-11-15T21:54:12.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a6c6b232-4abd-4e88-932d-997501adc0e9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
87832024-11-15T21:54:13.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
87842024-11-15T21:54:13.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87852024-11-15T21:54:13.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
87862024-11-15T21:54:13.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87872024-11-15T21:54:13.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87882024-11-15T21:54:13.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87892024-11-15T21:54:13.037ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87902024-11-15T21:54:13.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87912024-11-15T21:54:13.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87922024-11-15T21:54:13.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.56725ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87932024-11-15T21:54:13.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87942024-11-15T21:54:13.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87952024-11-15T21:54:13.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87962024-11-15T21:54:13.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87972024-11-15T21:54:13.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87982024-11-15T21:54:13.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87992024-11-15T21:54:13.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
88002024-11-15T21:54:13.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88012024-11-15T21:54:13.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88022024-11-15T21:54:13.058ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
88032024-11-15T21:54:13.058ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.448762ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
88042024-11-15T21:54:13.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1fcc2c92-38c5-4d84-ba64-35642e45b7e1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88052024-11-15T21:54:13.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1fcc2c92-38c5-4d84-ba64-35642e45b7e1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88062024-11-15T21:54:13.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1fcc2c92-38c5-4d84-ba64-35642e45b7e1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88072024-11-15T21:54:14.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0214d340-7839-4dbb-ba5c-28fa330bb85c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88082024-11-15T21:54:14.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0214d340-7839-4dbb-ba5c-28fa330bb85c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88092024-11-15T21:54:14.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0214d340-7839-4dbb-ba5c-28fa330bb85c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88102024-11-15T21:54:15.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14373c6f-eaa0-43e4-9157-75c9c046f3ee roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88112024-11-15T21:54:15.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14373c6f-eaa0-43e4-9157-75c9c046f3ee resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88122024-11-15T21:54:15.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 14373c6f-eaa0-43e4-9157-75c9c046f3ee response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88132024-11-15T21:54:15.679ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1447 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 5a1e58a6-0dd5-45a3-99b9-305c8b404558 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
88142024-11-15T21:54:16.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f24dcab7-162f-46e1-9424-0c60ae81cf4e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88152024-11-15T21:54:16.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f24dcab7-162f-46e1-9424-0c60ae81cf4e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88162024-11-15T21:54:16.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f24dcab7-162f-46e1-9424-0c60ae81cf4e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88172024-11-15T21:54:17.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1fca29f7-c8c3-44ca-8c7a-d050af504cd6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88182024-11-15T21:54:17.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1fca29f7-c8c3-44ca-8c7a-d050af504cd6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88192024-11-15T21:54:17.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2787 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1fca29f7-c8c3-44ca-8c7a-d050af504cd6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88202024-11-15T21:54:18.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9a53bf90-9604-4d84-9975-8aaca670465c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88212024-11-15T21:54:18.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9a53bf90-9604-4d84-9975-8aaca670465c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88222024-11-15T21:54:18.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9a53bf90-9604-4d84-9975-8aaca670465c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88232024-11-15T21:54:19.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3641a3e-bd5f-48ec-bd75-c316c0fd6c38 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88242024-11-15T21:54:19.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3641a3e-bd5f-48ec-bd75-c316c0fd6c38 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88252024-11-15T21:54:19.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3641a3e-bd5f-48ec-bd75-c316c0fd6c38 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88262024-11-15T21:54:20.011ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6af3f0e7-3192-42d1-a0ec-7697238c84e5 uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-15T21:54:20.011514243Z }
88272024-11-15T21:54:20.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6af3f0e7-3192-42d1-a0ec-7697238c84e5 roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88282024-11-15T21:54:20.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6af3f0e7-3192-42d1-a0ec-7697238c84e5 resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88292024-11-15T21:54:20.067ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:159 retry_after (ms) = 31 transaction = vmm_and_migration_update_runtime
88302024-11-15T21:54:20.106ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:115 transaction = vmm_and_migration_update_runtime
88312024-11-15T21:54:20.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95047 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6af3f0e7-3192-42d1-a0ec-7697238c84e5 response_code = 204 uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88322024-11-15T21:54:20.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d32c046f-498e-4869-b592-25aec83e7079 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88332024-11-15T21:54:20.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d32c046f-498e-4869-b592-25aec83e7079 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88342024-11-15T21:54:20.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d32c046f-498e-4869-b592-25aec83e7079 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88352024-11-15T21:54:20.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 3936be7d-34bc-472c-b04a-c178168051fd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
88362024-11-15T21:54:20.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 3936be7d-34bc-472c-b04a-c178168051fd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
88372024-11-15T21:54:20.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 3936be7d-34bc-472c-b04a-c178168051fd response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
88382024-11-15T21:54:20.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 760fdbd4-1b97-44dc-b4e2-c06757c160ee roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
88392024-11-15T21:54:20.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 760fdbd4-1b97-44dc-b4e2-c06757c160ee resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
88402024-11-15T21:54:20.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 760fdbd4-1b97-44dc-b4e2-c06757c160ee response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
88412024-11-15T21:54:20.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = afc75a01-5813-4197-af54-0ac1450a6d70 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
88422024-11-15T21:54:20.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = afc75a01-5813-4197-af54-0ac1450a6d70 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
88432024-11-15T21:54:20.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = afc75a01-5813-4197-af54-0ac1450a6d70 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
88442024-11-15T21:54:20.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = f60c2a97-8b92-413b-a4ee-5e17ba2956ee roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYjVhOTZlNS05NTNiLTRhNDItOTcyOC0wNTk2ZjI4MzI3YmEifX0%3D
88452024-11-15T21:54:20.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = f60c2a97-8b92-413b-a4ee-5e17ba2956ee resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYjVhOTZlNS05NTNiLTRhNDItOTcyOC0wNTk2ZjI4MzI3YmEifX0%3D
88462024-11-15T21:54:20.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = f60c2a97-8b92-413b-a4ee-5e17ba2956ee response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYjVhOTZlNS05NTNiLTRhNDItOTcyOC0wNTk2ZjI4MzI3YmEifX0%3D
88472024-11-15T21:54:21.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0a6ee317-a4a6-4f78-9848-509d2b08c8eb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88482024-11-15T21:54:21.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0a6ee317-a4a6-4f78-9848-509d2b08c8eb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88492024-11-15T21:54:21.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0a6ee317-a4a6-4f78-9848-509d2b08c8eb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88502024-11-15T21:54:21.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 23b20235-bdcb-4275-9574-dc04e5bfff23 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
88512024-11-15T21:54:21.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 23b20235-bdcb-4275-9574-dc04e5bfff23 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
88522024-11-15T21:54:21.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 23b20235-bdcb-4275-9574-dc04e5bfff23 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
88532024-11-15T21:54:22.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f4b01372-353b-4809-8843-5c3e757eff6a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88542024-11-15T21:54:22.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f4b01372-353b-4809-8843-5c3e757eff6a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88552024-11-15T21:54:22.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f4b01372-353b-4809-8843-5c3e757eff6a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
88562024-11-15T21:54:22.579ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-15T21:54:22.579366209Z }
88572024-11-15T21:54:22.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88582024-11-15T21:54:22.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88592024-11-15T21:54:22.596ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8 vmm_needs_update = true
88602024-11-15T21:54:22.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88612024-11-15T21:54:22.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88622024-11-15T21:54:22.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88632024-11-15T21:54:22.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88642024-11-15T21:54:22.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88652024-11-15T21:54:22.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88662024-11-15T21:54:22.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88672024-11-15T21:54:22.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88682024-11-15T21:54:22.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88692024-11-15T21:54:22.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88702024-11-15T21:54:22.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88712024-11-15T21:54:22.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88722024-11-15T21:54:22.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88732024-11-15T21:54:22.613ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: dba2ea2d-2632-4f3f-a3b4-c59c04735431, lookup_type: ById(dba2ea2d-2632-4f3f-a3b4-c59c04735431) }, key: 607fdceb-9960-4ed0-9f9f-546578dad0a1, lookup_type: ById(607fdceb-9960-4ed0-9f9f-546578dad0a1) }, key: db5a96e5-953b-4a42-9728-0596f28327ba, lookup_type: ById(db5a96e5-953b-4a42-9728-0596f28327ba) } result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88742024-11-15T21:54:22.615ZINFOnexus (dropshot_internal): starting update saga for db5a96e5-953b-4a42-9728-0596f28327ba actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-15T21:54:22.579366209Z }
88752024-11-15T21:54:22.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36118 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd response_code = 204 uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88762024-11-15T21:54:22.615ZDEBGnexus (dropshot_internal): preparing instance-update saga for db5a96e5-953b-4a42-9728-0596f28327ba... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = db5a96e5-953b-4a42-9728-0596f28327ba local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba913f15-9661-4712-9ad6-f5013270d0bd uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88772024-11-15T21:54:22.615ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update
88782024-11-15T21:54:22.615ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"db5a96e5-953b-4a42-9728-0596f28327ba","lookup_type":{"ById":"db5a96e5-953b-4a42-9728-0596f28327ba"},"parent":{"key":"607fdceb-9960-4ed0-9f9f-546578dad0a1","lookup_type":{"ById":"607fdceb-9960-4ed0-9f9f-546578dad0a1"},"parent":{"key":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","lookup_type":{"ById":"dba2ea2d-2632-4f3f-a3b4-c59c04735431"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
88792024-11-15T21:54:22.615ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update
88802024-11-15T21:54:22.616ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c6d1e847-bd44-4e8b-9201-fc542dbed45c uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-15T21:54:22.579366209Z }
88812024-11-15T21:54:22.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c6d1e847-bd44-4e8b-9201-fc542dbed45c roles = RoleSet { roles: {} } uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88822024-11-15T21:54:22.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c6d1e847-bd44-4e8b-9201-fc542dbed45c resource = Database result = Ok(()) uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88832024-11-15T21:54:22.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5897 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c6d1e847-bd44-4e8b-9201-fc542dbed45c response_code = 204 uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
88842024-11-15T21:54:22.646ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update
88852024-11-15T21:54:22.646ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
88862024-11-15T21:54:22.647ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
88872024-11-15T21:54:22.647ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
88882024-11-15T21:54:22.654ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
88892024-11-15T21:54:22.654ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
88902024-11-15T21:54:22.658ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
88912024-11-15T21:54:22.658ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
88922024-11-15T21:54:22.662ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
88932024-11-15T21:54:22.662ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("771f120b-026b-4114-9cf2-3f64516c5b59")) node_id = 0 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
88942024-11-15T21:54:22.666ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
88952024-11-15T21:54:22.666ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
88962024-11-15T21:54:22.673ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update
88972024-11-15T21:54:22.673ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
88982024-11-15T21:54:22.673ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
88992024-11-15T21:54:22.676ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89002024-11-15T21:54:22.676ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89012024-11-15T21:54:22.677ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89022024-11-15T21:54:22.678ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89032024-11-15T21:54:22.680ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89042024-11-15T21:54:22.680ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89052024-11-15T21:54:22.681ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89062024-11-15T21:54:22.681ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89072024-11-15T21:54:22.683ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89082024-11-15T21:54:22.683ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89092024-11-15T21:54:22.684ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89102024-11-15T21:54:22.687ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: dba2ea2d-2632-4f3f-a3b4-c59c04735431, lookup_type: ById(dba2ea2d-2632-4f3f-a3b4-c59c04735431) }, key: 607fdceb-9960-4ed0-9f9f-546578dad0a1, lookup_type: ById(607fdceb-9960-4ed0-9f9f-546578dad0a1) }, key: db5a96e5-953b-4a42-9728-0596f28327ba, lookup_type: ById(db5a96e5-953b-4a42-9728-0596f28327ba) } result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89112024-11-15T21:54:22.687ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance updater_id = 771f120b-026b-4114-9cf2-3f64516c5b59
89122024-11-15T21:54:22.687ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89132024-11-15T21:54:22.687ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89142024-11-15T21:54:22.703ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance updater_id = 771f120b-026b-4114-9cf2-3f64516c5b59
89152024-11-15T21:54:22.703ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89162024-11-15T21:54:22.703ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance
89172024-11-15T21:54:22.707ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = db5a96e5-953b-4a42-9728-0596f28327ba locked_gen = Generation(Generation(2)) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = LockInstance updater_id = 771f120b-026b-4114-9cf2-3f64516c5b59
89182024-11-15T21:54:22.707ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89192024-11-15T21:54:22.707ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("771f120b-026b-4114-9cf2-3f64516c5b59")}) node_id = 1 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
89202024-11-15T21:54:22.711ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89212024-11-15T21:54:22.711ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
89222024-11-15T21:54:22.714ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89232024-11-15T21:54:22.715ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89242024-11-15T21:54:22.716ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89252024-11-15T21:54:22.716ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89262024-11-15T21:54:22.717ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89272024-11-15T21:54:22.717ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89282024-11-15T21:54:22.718ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89292024-11-15T21:54:22.721ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: dba2ea2d-2632-4f3f-a3b4-c59c04735431, lookup_type: ById(dba2ea2d-2632-4f3f-a3b4-c59c04735431) }, key: 607fdceb-9960-4ed0-9f9f-546578dad0a1, lookup_type: ById(607fdceb-9960-4ed0-9f9f-546578dad0a1) }, key: db5a96e5-953b-4a42-9728-0596f28327ba, lookup_type: ById(db5a96e5-953b-4a42-9728-0596f28327ba) } result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89302024-11-15T21:54:22.721ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89312024-11-15T21:54:22.721ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89322024-11-15T21:54:22.727ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 36f20a22-3f40-4064-a8be-fea89629f5a8, time_created: 2024-11-15T21:54:01.844424Z, time_deleted: None, instance_id: db5a96e5-953b-4a42-9728-0596f28327ba, sled_id: 78d47478-5af8-488d-89c5-11be23443b63, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-15T21:54:22.579366Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-15T21:53:59.494349Z, gen: Generation(Generation(3)), propolis_id: Some(36f20a22-3f40-4064-a8be-fea89629f5a8), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(36f20a22-3f40-4064-a8be-fea89629f5a8 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-15T21:54:22.727047747Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
89332024-11-15T21:54:22.729ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
89342024-11-15T21:54:22.729ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"db5a96e5-953b-4a42-9728-0596f28327ba","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"36f20a22-3f40-4064-a8be-fea89629f5a8"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"db5a96e5-953b-4a42-9728-0596f28327ba","lookup_type":{"ById":"db5a96e5-953b-4a42-9728-0596f28327ba"},"parent":{"key":"607fdceb-9960-4ed0-9f9f-546578dad0a1","lookup_type":{"ById":"607fdceb-9960-4ed0-9f9f-546578dad0a1"},"parent":{"key":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","lookup_type":{"ById":"dba2ea2d-2632-4f3f-a3b4-c59c04735431"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"771f120b-026b-4114-9cf2-3f64516c5b59"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"607fdceb-9960-4ed0-9f9f-546578dad0a1","ram_diff":1073741824},"destroy_active_vmm":"36f20a22-3f40-4064-a8be-fea89629f5a8","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-15T21:54:22.727047747Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89352024-11-15T21:54:22.729ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
89362024-11-15T21:54:22.775ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
89372024-11-15T21:54:22.775ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89382024-11-15T21:54:22.775ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89392024-11-15T21:54:22.775ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89402024-11-15T21:54:22.780ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89412024-11-15T21:54:22.780ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89422024-11-15T21:54:22.790ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89432024-11-15T21:54:22.790ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89442024-11-15T21:54:22.799ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89452024-11-15T21:54:22.799ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("bbe87ed6-f297-4240-b41e-644c0189fa99")) node_id = 0 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89462024-11-15T21:54:22.805ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89472024-11-15T21:54:22.805ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89482024-11-15T21:54:22.814ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = db5a96e5-953b-4a42-9728-0596f28327ba parent_lock = UpdaterLock { updater_id: 771f120b-026b-4114-9cf2-3f64516c5b59, locked_gen: Generation(Generation(2)) } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
89492024-11-15T21:54:22.814ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = BecomeUpdater
89502024-11-15T21:54:22.814ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = BecomeUpdater
89512024-11-15T21:54:22.834ZDEBGnexus (SagaExecutor): inherited lock from 771f120b-026b-4114-9cf2-3f64516c5b59 to bbe87ed6-f297-4240-b41e-644c0189fa99 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = db5a96e5-953b-4a42-9728-0596f28327ba locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 771f120b-026b-4114-9cf2-3f64516c5b59 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = BecomeUpdater updater_id = bbe87ed6-f297-4240-b41e-644c0189fa99
89522024-11-15T21:54:22.834ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
89532024-11-15T21:54:22.834ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89542024-11-15T21:54:22.834ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("bbe87ed6-f297-4240-b41e-644c0189fa99")}) node_id = 1 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89552024-11-15T21:54:22.839ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89562024-11-15T21:54:22.839ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89572024-11-15T21:54:22.842ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89582024-11-15T21:54:22.842ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89592024-11-15T21:54:22.846ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89602024-11-15T21:54:22.846ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89612024-11-15T21:54:22.852ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
89622024-11-15T21:54:22.855ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba
89632024-11-15T21:54:22.858ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = UpdateNetworkConfig
89642024-11-15T21:54:22.861ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = UpdateNetworkConfig
89652024-11-15T21:54:22.864ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = UpdateNetworkConfig
89662024-11-15T21:54:22.864ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = UpdateNetworkConfig
89672024-11-15T21:54:22.867ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
89682024-11-15T21:54:22.867ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = UpdateNetworkConfig
89692024-11-15T21:54:22.868ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = UpdateNetworkConfig
89702024-11-15T21:54:22.870ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
89712024-11-15T21:54:22.870ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
89722024-11-15T21:54:22.871ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
89732024-11-15T21:54:22.872ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
89742024-11-15T21:54:22.874ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
89752024-11-15T21:54:22.874ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
89762024-11-15T21:54:22.874ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
89772024-11-15T21:54:22.886ZDEBGnexus: notifying dendrite of updates instance_id = Some(db5a96e5-953b-4a42-9728-0596f28327ba (instance)) switch = switch0
89782024-11-15T21:54:22.886ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 825489306 } })
89792024-11-15T21:54:22.887ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
89802024-11-15T21:54:22.941ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
89812024-11-15T21:54:22.941ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89822024-11-15T21:54:22.941ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd4e0d39-1596-4586-b95d-ff6a2204a8ee", "content-length": "26", "date": "Fri, 15 Nov 2024 21:54:22 GMT"} })
89832024-11-15T21:54:22.941ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89842024-11-15T21:54:22.943ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89852024-11-15T21:54:22.990ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
89862024-11-15T21:54:22.990ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ea4a0bb-9305-4414-8372-4d86fe97ef49", "content-length": "4", "date": "Fri, 15 Nov 2024 21:54:22 GMT"} })
89872024-11-15T21:54:22.992ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89882024-11-15T21:54:22.993ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89892024-11-15T21:54:23.002ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89902024-11-15T21:54:23.002ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89912024-11-15T21:54:23.009ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ReleaseVirtualProvisioning
89922024-11-15T21:54:23.009ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ReleaseVirtualProvisioning
89932024-11-15T21:54:23.020ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-15T21:54:23.012451Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 607fdceb-9960-4ed0-9f9f-546578dad0a1, time_modified: Some(2024-11-15T21:54:23.012451Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, time_modified: Some(2024-11-15T21:54:23.012451Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
89942024-11-15T21:54:23.020ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89952024-11-15T21:54:23.020ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89962024-11-15T21:54:23.024ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
89972024-11-15T21:54:23.024ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
89982024-11-15T21:54:23.028ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
89992024-11-15T21:54:23.031ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = UnassignOximeterProducer
90002024-11-15T21:54:23.031ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = UnassignOximeterProducer
90012024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
90022024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
90032024-11-15T21:54:23.034ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
90042024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90052024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
90062024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90072024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
90082024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
90092024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
90102024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
90112024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90122024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
90132024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
90142024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
90152024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90162024-11-15T21:54:23.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
90172024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
90182024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90192024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
90202024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
90212024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90222024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90232024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
90242024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90252024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
90262024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
90272024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
90282024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
90292024-11-15T21:54:23.035ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
90302024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.05\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
90312024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
90322024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
90332024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
90342024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90352024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
90362024-11-15T21:54:23.035ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:44:23.035089826 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
90372024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
90382024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
90392024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90402024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
90412024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
90422024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90432024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
90442024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90452024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90462024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
90472024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90482024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
90492024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
90502024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
90512024-11-15T21:54:23.035ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
90522024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90532024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90542024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
90552024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90562024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
90572024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90582024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
90592024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
90602024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90612024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90622024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
90632024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
90642024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
90652024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
90662024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
90672024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
90682024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90692024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90702024-11-15T21:54:23.035ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 974182131 } })
90712024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90722024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90732024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
90742024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90752024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90762024-11-15T21:54:23.035ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 974371412 } })
90772024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
90782024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90792024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90802024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90812024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
90822024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
90832024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90842024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90852024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90862024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
90872024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90882024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90892024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90902024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90912024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90922024-11-15T21:54:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90932024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
90942024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.145087ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
90952024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90962024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90972024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
90982024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.155358ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
90992024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91002024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91012024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91022024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91032024-11-15T21:54:23.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91042024-11-15T21:54:23.036ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb producer_id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
91052024-11-15T21:54:23.036ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = UnassignOximeterProducer
91062024-11-15T21:54:23.037ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = UnassignOximeterProducer
91072024-11-15T21:54:23.037ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91082024-11-15T21:54:23.039ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.136277ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
91092024-11-15T21:54:23.039ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 978022116 } })
91102024-11-15T21:54:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
91112024-11-15T21:54:23.039ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
91122024-11-15T21:54:23.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
91132024-11-15T21:54:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
91142024-11-15T21:54:23.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91152024-11-15T21:54:23.042ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91162024-11-15T21:54:23.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91172024-11-15T21:54:23.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91182024-11-15T21:54:23.043ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.840847ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
91192024-11-15T21:54:23.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91202024-11-15T21:54:23.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91212024-11-15T21:54:23.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91222024-11-15T21:54:23.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91232024-11-15T21:54:23.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91242024-11-15T21:54:23.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91252024-11-15T21:54:23.048ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:44:23.035089826 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
91262024-11-15T21:54:23.048ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.302956ms iteration = 13 status = {"expiration":"2024-11-15T21:44:23.035089826Z","pruned":[]}
91272024-11-15T21:54:23.050ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 988924816 } })
91282024-11-15T21:54:23.050ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
91292024-11-15T21:54:23.050ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91302024-11-15T21:54:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
91312024-11-15T21:54:23.052ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91322024-11-15T21:54:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91332024-11-15T21:54:23.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91342024-11-15T21:54:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91352024-11-15T21:54:23.055ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91362024-11-15T21:54:23.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91372024-11-15T21:54:23.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91382024-11-15T21:54:23.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91392024-11-15T21:54:23.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91402024-11-15T21:54:23.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91412024-11-15T21:54:23.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91422024-11-15T21:54:23.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
91432024-11-15T21:54:23.058ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91442024-11-15T21:54:23.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91452024-11-15T21:54:23.060ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91462024-11-15T21:54:23.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
91472024-11-15T21:54:23.063ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91482024-11-15T21:54:23.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91492024-11-15T21:54:23.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91502024-11-15T21:54:23.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91512024-11-15T21:54:23.077ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91522024-11-15T21:54:23.077ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
91532024-11-15T21:54:23.077ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91542024-11-15T21:54:23.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91552024-11-15T21:54:23.083ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.318433ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
91562024-11-15T21:54:23.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91572024-11-15T21:54:23.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91582024-11-15T21:54:23.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91592024-11-15T21:54:23.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91602024-11-15T21:54:23.088ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
91612024-11-15T21:54:23.088ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
91622024-11-15T21:54:23.088ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 53.130995ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
91632024-11-15T21:54:23.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91642024-11-15T21:54:23.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.262352ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
91652024-11-15T21:54:23.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91662024-11-15T21:54:23.093ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91672024-11-15T21:54:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
91682024-11-15T21:54:23.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91692024-11-15T21:54:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91702024-11-15T21:54:23.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
91712024-11-15T21:54:23.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91722024-11-15T21:54:23.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91732024-11-15T21:54:23.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
91742024-11-15T21:54:23.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91752024-11-15T21:54:23.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
91762024-11-15T21:54:23.098ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91772024-11-15T21:54:23.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91782024-11-15T21:54:23.100ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91792024-11-15T21:54:23.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
91802024-11-15T21:54:23.102ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91812024-11-15T21:54:23.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91822024-11-15T21:54:23.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91832024-11-15T21:54:23.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91842024-11-15T21:54:23.104ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91852024-11-15T21:54:23.105ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
91862024-11-15T21:54:23.105ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
91872024-11-15T21:54:23.105ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.529417ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
91882024-11-15T21:54:23.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
91892024-11-15T21:54:23.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91902024-11-15T21:54:23.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91912024-11-15T21:54:23.107ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91922024-11-15T21:54:23.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
91932024-11-15T21:54:23.109ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91942024-11-15T21:54:23.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91952024-11-15T21:54:23.110ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
91962024-11-15T21:54:23.110ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
91972024-11-15T21:54:23.110ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
91982024-11-15T21:54:23.110ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91992024-11-15T21:54:23.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92002024-11-15T21:54:23.126ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
92012024-11-15T21:54:23.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92022024-11-15T21:54:23.139ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
92032024-11-15T21:54:23.147ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
92042024-11-15T21:54:23.164ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
92052024-11-15T21:54:23.164ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92062024-11-15T21:54:23.164ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d4251f9-8d12-4354-8a8f-23963359ba67", "content-length": "26", "date": "Fri, 15 Nov 2024 21:54:22 GMT"} })
92072024-11-15T21:54:23.164ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92082024-11-15T21:54:23.166ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92092024-11-15T21:54:23.259ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
92102024-11-15T21:54:23.259ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92112024-11-15T21:54:23.259ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf5516fb-c159-409b-a2d4-23ce8c8ff60b", "content-length": "26", "date": "Fri, 15 Nov 2024 21:54:22 GMT"} })
92122024-11-15T21:54:23.259ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92132024-11-15T21:54:23.260ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92142024-11-15T21:54:23.291ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
92152024-11-15T21:54:23.291ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
92162024-11-15T21:54:23.291ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7dfc2963-e1ba-45e4-afff-2b997ee591f7", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92172024-11-15T21:54:23.292ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92182024-11-15T21:54:23.293ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7acc0fad-4c12-4d04-bb40-14a477fecc06", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92192024-11-15T21:54:23.293ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92202024-11-15T21:54:23.295ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
92212024-11-15T21:54:23.295ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92222024-11-15T21:54:23.295ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 260.477111ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
92232024-11-15T21:54:23.299ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92242024-11-15T21:54:23.300ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d4e3939-894b-47a4-89a3-26cb5e43ca6c", "content-length": "2", "date": "Fri, 15 Nov 2024 21:54:22 GMT"} })
92252024-11-15T21:54:23.300ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/db5a96e5-953b-4a42-9728-0596f28327ba
92262024-11-15T21:54:23.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92272024-11-15T21:54:23.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92282024-11-15T21:54:23.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92292024-11-15T21:54:23.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92302024-11-15T21:54:23.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92312024-11-15T21:54:23.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92322024-11-15T21:54:23.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92332024-11-15T21:54:23.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92342024-11-15T21:54:23.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92352024-11-15T21:54:23.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92362024-11-15T21:54:23.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92372024-11-15T21:54:23.314ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1745, tv_nsec: 253020801 } })
92382024-11-15T21:54:23.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92392024-11-15T21:54:23.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 279.734176ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92402024-11-15T21:54:23.314ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
92412024-11-15T21:54:23.315ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92422024-11-15T21:54:23.316ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 280.920484ms iteration = 6 status = {"nsuccess":5}
92432024-11-15T21:54:23.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92442024-11-15T21:54:23.322ZDEBGnexus (SagaExecutor): client response oximeter-collector = db5a96e5-953b-4a42-9728-0596f28327ba result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/db5a96e5-953b-4a42-9728-0596f28327ba", status: 204, headers: {"x-request-id": "128a7ba3-1510-456c-9b35-223e9269fb4e", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} }) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
92452024-11-15T21:54:23.322ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb producer_id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
92462024-11-15T21:54:23.322ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 287.481606ms iteration = 25 status = null
92472024-11-15T21:54:23.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92482024-11-15T21:54:23.324ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
92492024-11-15T21:54:23.324ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
92502024-11-15T21:54:23.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92512024-11-15T21:54:23.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92522024-11-15T21:54:23.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92532024-11-15T21:54:23.329ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
92542024-11-15T21:54:23.329ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
92552024-11-15T21:54:23.333ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = db5a96e5-953b-4a42-9728-0596f28327ba lock = UpdaterLock { updater_id: bbe87ed6-f297-4240-b41e-644c0189fa99, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-15T21:54:22.727047747Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
92562024-11-15T21:54:23.333ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = CommitInstanceUpdates
92572024-11-15T21:54:23.334ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = CommitInstanceUpdates
92582024-11-15T21:54:23.345ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 310.544476ms iteration = 25 status = {}
92592024-11-15T21:54:23.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92602024-11-15T21:54:23.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92612024-11-15T21:54:23.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92622024-11-15T21:54:23.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92632024-11-15T21:54:23.356ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92642024-11-15T21:54:23.356ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
92652024-11-15T21:54:23.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92662024-11-15T21:54:23.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92672024-11-15T21:54:23.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92682024-11-15T21:54:23.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92692024-11-15T21:54:23.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 327.003212ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92702024-11-15T21:54:23.362ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
92712024-11-15T21:54:23.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92722024-11-15T21:54:23.363ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5bf64f6b-e47c-452b-9917-da1f74baa108", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92732024-11-15T21:54:23.363ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92742024-11-15T21:54:23.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92752024-11-15T21:54:23.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92762024-11-15T21:54:23.365ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "af201c69-85b5-4223-8b07-4b87ca0f868b", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92772024-11-15T21:54:23.365ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92782024-11-15T21:54:23.367ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b90d6063-071e-406d-9fa1-a7db914177d2", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92792024-11-15T21:54:23.367ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92802024-11-15T21:54:23.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92812024-11-15T21:54:23.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92822024-11-15T21:54:23.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92832024-11-15T21:54:23.369ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
92842024-11-15T21:54:23.369ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 334.32321ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
92852024-11-15T21:54:23.369ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92862024-11-15T21:54:23.369ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 334.562342ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
92872024-11-15T21:54:23.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 340.54177ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
92882024-11-15T21:54:23.380ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
92892024-11-15T21:54:23.380ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92902024-11-15T21:54:23.381ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c37d3cab-3031-4a9c-9640-e5ebc5911a4e", "content-length": "26", "date": "Fri, 15 Nov 2024 21:54:22 GMT"} })
92912024-11-15T21:54:23.381ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92922024-11-15T21:54:23.381ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92932024-11-15T21:54:23.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92942024-11-15T21:54:23.382ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
92952024-11-15T21:54:23.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
92962024-11-15T21:54:23.385ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92972024-11-15T21:54:23.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92982024-11-15T21:54:23.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
92992024-11-15T21:54:23.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93002024-11-15T21:54:23.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93012024-11-15T21:54:23.386ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 350.805777ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
93022024-11-15T21:54:23.387ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93032024-11-15T21:54:23.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 40abd725-4ae4-43fd-bec4-a00a4e0e5faa roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
93042024-11-15T21:54:23.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93052024-11-15T21:54:23.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 40abd725-4ae4-43fd-bec4-a00a4e0e5faa resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
93062024-11-15T21:54:23.389ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93072024-11-15T21:54:23.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 40abd725-4ae4-43fd-bec4-a00a4e0e5faa response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
93082024-11-15T21:54:23.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
93092024-11-15T21:54:23.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93102024-11-15T21:54:23.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93112024-11-15T21:54:23.393ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba new_runtime = InstanceRuntimeState { time_updated: 2024-11-15T21:54:22.727047747Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
93122024-11-15T21:54:23.393ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
93132024-11-15T21:54:23.393ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
93142024-11-15T21:54:23.396ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
93152024-11-15T21:54:23.396ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
93162024-11-15T21:54:23.396ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
93172024-11-15T21:54:23.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93182024-11-15T21:54:23.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93192024-11-15T21:54:23.396ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93202024-11-15T21:54:23.396ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93212024-11-15T21:54:23.396ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 361.879619ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93222024-11-15T21:54:23.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93232024-11-15T21:54:23.398ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
93242024-11-15T21:54:23.398ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
93252024-11-15T21:54:23.398ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
93262024-11-15T21:54:23.399ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 364.072903ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
93272024-11-15T21:54:23.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93282024-11-15T21:54:23.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93292024-11-15T21:54:23.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93302024-11-15T21:54:23.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93312024-11-15T21:54:23.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
93322024-11-15T21:54:23.413ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93332024-11-15T21:54:23.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93342024-11-15T21:54:23.419ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
93352024-11-15T21:54:23.420ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
93362024-11-15T21:54:23.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93372024-11-15T21:54:23.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93382024-11-15T21:54:23.439ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
93392024-11-15T21:54:23.439ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 403.900541ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
93402024-11-15T21:54:23.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93412024-11-15T21:54:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93422024-11-15T21:54:23.445ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 410.902987ms iteration = 29 status = {"physical_disks_added":0}
93432024-11-15T21:54:23.449ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
93442024-11-15T21:54:23.449ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 414.51158ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
93452024-11-15T21:54:23.460ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93462024-11-15T21:54:23.460ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93472024-11-15T21:54:23.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93482024-11-15T21:54:23.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93492024-11-15T21:54:23.463ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 427.991269ms iteration = 25 status = 0
93502024-11-15T21:54:23.465ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93512024-11-15T21:54:23.465ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93522024-11-15T21:54:23.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93532024-11-15T21:54:23.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
93542024-11-15T21:54:23.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93552024-11-15T21:54:23.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93562024-11-15T21:54:23.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93572024-11-15T21:54:23.467ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
93582024-11-15T21:54:23.467ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
93592024-11-15T21:54:23.467ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
93602024-11-15T21:54:23.467ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 432.86331ms iteration = 14 status = {"generation":1}
93612024-11-15T21:54:23.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93622024-11-15T21:54:23.468ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93632024-11-15T21:54:23.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93642024-11-15T21:54:23.472ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
93652024-11-15T21:54:23.472ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("db5a96e5-953b-4a42-9728-0596f28327ba"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("36f20a22-3f40-4064-a8be-fea89629f5a8")}) node_id = 7 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
93662024-11-15T21:54:23.477ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
93672024-11-15T21:54:23.477ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
93682024-11-15T21:54:23.481ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
93692024-11-15T21:54:23.481ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
93702024-11-15T21:54:23.485ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
93712024-11-15T21:54:23.485ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
93722024-11-15T21:54:23.490ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
93732024-11-15T21:54:23.490ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
93742024-11-15T21:54:23.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93752024-11-15T21:54:23.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93762024-11-15T21:54:23.491ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
93772024-11-15T21:54:23.491ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ReleaseSledResources
93782024-11-15T21:54:23.491ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ReleaseSledResources
93792024-11-15T21:54:23.531ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93802024-11-15T21:54:23.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93812024-11-15T21:54:23.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93822024-11-15T21:54:23.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93832024-11-15T21:54:23.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93842024-11-15T21:54:23.538ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
93852024-11-15T21:54:23.538ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
93862024-11-15T21:54:23.538ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
93872024-11-15T21:54:23.538ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 503.289557ms iteration = 14 status = {"generation":2}
93882024-11-15T21:54:23.542ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
93892024-11-15T21:54:23.542ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
93902024-11-15T21:54:23.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93912024-11-15T21:54:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93922024-11-15T21:54:23.545ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
93932024-11-15T21:54:23.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93942024-11-15T21:54:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93952024-11-15T21:54:23.546ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
93962024-11-15T21:54:23.546ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
93972024-11-15T21:54:23.550ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
93982024-11-15T21:54:23.550ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = MarkVmmDeleted
93992024-11-15T21:54:23.550ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = MarkVmmDeleted
94002024-11-15T21:54:23.554ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94012024-11-15T21:54:23.555ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b3eb1a2-cea0-4336-b563-451912be5ab3", "content-length": "134", "date": "Fri, 15 Nov 2024 21:54:22 GMT"} })
94022024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94032024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
94042024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94052024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94062024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94072024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94082024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94092024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94102024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94112024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94122024-11-15T21:54:23.555ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
94132024-11-15T21:54:23.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94142024-11-15T21:54:23.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94152024-11-15T21:54:23.557ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94162024-11-15T21:54:23.557ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "425ab6bf-4920-4436-b1bd-b4ec82abd0fe", "content-length": "2", "date": "Fri, 15 Nov 2024 21:54:22 GMT"} })
94172024-11-15T21:54:23.557ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94182024-11-15T21:54:23.557ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc9aac57-a7dc-4eb0-a9c8-5640014fadc9", "content-length": "52", "date": "Fri, 15 Nov 2024 21:54:22 GMT"} })
94192024-11-15T21:54:23.557ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
94202024-11-15T21:54:23.557ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94212024-11-15T21:54:23.557ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94222024-11-15T21:54:23.557ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
94232024-11-15T21:54:23.561ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94242024-11-15T21:54:23.561ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
94252024-11-15T21:54:23.564ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94262024-11-15T21:54:23.564ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
94272024-11-15T21:54:23.567ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "19e05366-96b8-4514-bab2-fcc5edc163f5", "content-length": "372", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
94282024-11-15T21:54:23.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94292024-11-15T21:54:23.567ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94302024-11-15T21:54:23.567ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
94312024-11-15T21:54:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94322024-11-15T21:54:23.567ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "084feaa3-946d-48dc-a1d4-2d219f7b5694", "content-length": "811", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
94332024-11-15T21:54:23.567ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(12858275) }} sled = sock
94342024-11-15T21:54:23.567ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
94352024-11-15T21:54:23.567ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
94362024-11-15T21:54:23.569ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 534.385139ms iteration = 25 status = {}
94372024-11-15T21:54:23.569ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
94382024-11-15T21:54:23.569ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94392024-11-15T21:54:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94402024-11-15T21:54:23.571ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ChainSuccessorSaga
94412024-11-15T21:54:23.571ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ChainSuccessorSaga
94422024-11-15T21:54:23.573ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ChainSuccessorSaga
94432024-11-15T21:54:23.573ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ChainSuccessorSaga
94442024-11-15T21:54:23.574ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ChainSuccessorSaga
94452024-11-15T21:54:23.575ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ChainSuccessorSaga
94462024-11-15T21:54:23.607ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ChainSuccessorSaga
94472024-11-15T21:54:23.611ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: dba2ea2d-2632-4f3f-a3b4-c59c04735431, lookup_type: ById(dba2ea2d-2632-4f3f-a3b4-c59c04735431) }, key: 607fdceb-9960-4ed0-9f9f-546578dad0a1, lookup_type: ById(607fdceb-9960-4ed0-9f9f-546578dad0a1) }, key: db5a96e5-953b-4a42-9728-0596f28327ba, lookup_type: ById(db5a96e5-953b-4a42-9728-0596f28327ba) } result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ChainSuccessorSaga
94482024-11-15T21:54:23.611ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ChainSuccessorSaga
94492024-11-15T21:54:23.611ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_node = ChainSuccessorSaga
94502024-11-15T21:54:23.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 1ac5f21a-9fa5-40a2-997c-cc5e491d4f8c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
94512024-11-15T21:54:23.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 1ac5f21a-9fa5-40a2-997c-cc5e491d4f8c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
94522024-11-15T21:54:23.612ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94532024-11-15T21:54:23.612ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94542024-11-15T21:54:23.613ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ee8ecae2-4b83-47e1-b066-4a07491b2753", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
94552024-11-15T21:54:23.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94562024-11-15T21:54:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94572024-11-15T21:54:23.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 1ac5f21a-9fa5-40a2-997c-cc5e491d4f8c response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
94582024-11-15T21:54:23.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94592024-11-15T21:54:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94602024-11-15T21:54:23.617ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = db5a96e5-953b-4a42-9728-0596f28327ba karmic_state = WillReincarnate needs_reincarnation = false saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update
94612024-11-15T21:54:23.617ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94622024-11-15T21:54:23.617ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
94632024-11-15T21:54:23.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94642024-11-15T21:54:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94652024-11-15T21:54:23.621ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94662024-11-15T21:54:23.621ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
94672024-11-15T21:54:23.622ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94682024-11-15T21:54:23.622ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94692024-11-15T21:54:23.624ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94702024-11-15T21:54:23.624ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
94712024-11-15T21:54:23.624ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6f1764b6-2a6d-4f90-bfbf-4c75381df92b", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
94722024-11-15T21:54:23.626ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 590.930745ms iteration = 26 status = {}
94732024-11-15T21:54:23.626ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
94742024-11-15T21:54:23.626ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
94752024-11-15T21:54:23.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94762024-11-15T21:54:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94772024-11-15T21:54:23.627ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94782024-11-15T21:54:23.627ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f
94792024-11-15T21:54:23.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94802024-11-15T21:54:23.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94812024-11-15T21:54:23.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94822024-11-15T21:54:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94832024-11-15T21:54:23.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94842024-11-15T21:54:23.632ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94852024-11-15T21:54:23.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94862024-11-15T21:54:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94872024-11-15T21:54:23.662ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94882024-11-15T21:54:23.662ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f saga_name = instance-update saga_result = SagaResult { saga_id: e6084438-ad22-48f2-90ce-e9a3f207b24f, saga_log: SagaLog { saga_id: e6084438-ad22-48f2-90ce-e9a3f207b24f, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("bbe87ed6-f297-4240-b41e-644c0189fa99")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("bbe87ed6-f297-4240-b41e-644c0189fa99")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("db5a96e5-953b-4a42-9728-0596f28327ba"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("36f20a22-3f40-4064-a8be-fea89629f5a8")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("db5a96e5-953b-4a42-9728-0596f28327ba"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("36f20a22-3f40-4064-a8be-fea89629f5a8")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("bbe87ed6-f297-4240-b41e-644c0189fa99"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("bbe87ed6-f297-4240-b41e-644c0189fa99")}} }) }
94892024-11-15T21:54:23.662ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = e6084438-ad22-48f2-90ce-e9a3f207b24f instance_id = db5a96e5-953b-4a42-9728-0596f28327ba saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update
94902024-11-15T21:54:23.662ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94912024-11-15T21:54:23.662ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
94922024-11-15T21:54:23.665ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94932024-11-15T21:54:23.665ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
94942024-11-15T21:54:23.669ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94952024-11-15T21:54:23.669ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
94962024-11-15T21:54:23.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94972024-11-15T21:54:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94982024-11-15T21:54:23.673ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
94992024-11-15T21:54:23.673ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0
95002024-11-15T21:54:23.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95012024-11-15T21:54:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95022024-11-15T21:54:23.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95032024-11-15T21:54:23.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95042024-11-15T21:54:23.683ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95052024-11-15T21:54:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95062024-11-15T21:54:23.685ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95072024-11-15T21:54:23.687ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95082024-11-15T21:54:23.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95092024-11-15T21:54:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95102024-11-15T21:54:23.689ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "645ecb14-23fa-495e-9fb5-09e796917557", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
95112024-11-15T21:54:23.689ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
95122024-11-15T21:54:23.689ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95132024-11-15T21:54:23.689ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3cc6913-9a01-4406-b696-903fd3146131", "content-length": "682", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
95142024-11-15T21:54:23.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95152024-11-15T21:54:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95162024-11-15T21:54:23.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95172024-11-15T21:54:23.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95182024-11-15T21:54:23.706ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update sec_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
95192024-11-15T21:54:23.706ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0 saga_name = start-instance-update saga_result = SagaResult { saga_id: b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0, saga_log: SagaLog { saga_id: b0f70fd5-ca26-4cbb-aa6e-f67b7aa0c4a0, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("771f120b-026b-4114-9cf2-3f64516c5b59")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("771f120b-026b-4114-9cf2-3f64516c5b59")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("771f120b-026b-4114-9cf2-3f64516c5b59"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("771f120b-026b-4114-9cf2-3f64516c5b59")}} }) }
95202024-11-15T21:54:23.720ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95212024-11-15T21:54:23.720ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95222024-11-15T21:54:23.721ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "99eb5ac4-007e-47f6-8c6d-d85b03b1f130", "content-length": "372", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
95232024-11-15T21:54:23.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95242024-11-15T21:54:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95252024-11-15T21:54:23.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95262024-11-15T21:54:23.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95272024-11-15T21:54:23.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95282024-11-15T21:54:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95292024-11-15T21:54:23.733ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 698.897987ms iteration = 25 status = {}
95302024-11-15T21:54:23.736ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
95312024-11-15T21:54:23.736ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95322024-11-15T21:54:23.736ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b842ee9b-742e-46b9-a48b-894832842495", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
95332024-11-15T21:54:23.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95342024-11-15T21:54:23.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95352024-11-15T21:54:23.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95362024-11-15T21:54:23.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95372024-11-15T21:54:23.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95382024-11-15T21:54:23.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95392024-11-15T21:54:23.744ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95402024-11-15T21:54:23.744ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95412024-11-15T21:54:23.744ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e5879f85-4ab3-4dd9-bd12-f684ae8a0954", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
95422024-11-15T21:54:23.746ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 120.581793ms iteration = 27 status = {}
95432024-11-15T21:54:23.774ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95442024-11-15T21:54:23.774ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5501a5fa-b742-478e-a9b6-c8aae600549a", "content-length": "811", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
95452024-11-15T21:54:23.774ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(12858275) }} sled = sock
95462024-11-15T21:54:23.774ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(12858275) }] sled = sock
95472024-11-15T21:54:23.774ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = Some(Body) method = DELETE uri = http://[fd00:1122:3344:101::1]:12345/v2p
95482024-11-15T21:54:23.775ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 204, headers: {"x-request-id": "5fcea1d5-3d83-4f41-afca-ad0a2435de35", "date": "Fri, 15 Nov 2024 21:54:23 GMT"} })
95492024-11-15T21:54:23.775ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
95502024-11-15T21:54:23.777ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 208.202781ms iteration = 26 status = {}
95512024-11-15T21:54:24.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 59364e1f-b036-4e0d-ae3a-aab4048d219e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95522024-11-15T21:54:24.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 59364e1f-b036-4e0d-ae3a-aab4048d219e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95532024-11-15T21:54:24.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 59364e1f-b036-4e0d-ae3a-aab4048d219e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95542024-11-15T21:54:24.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 5cfeceb2-acce-4bf0-9cb8-052570a6a64e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
95552024-11-15T21:54:24.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 5cfeceb2-acce-4bf0-9cb8-052570a6a64e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
95562024-11-15T21:54:24.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 5cfeceb2-acce-4bf0-9cb8-052570a6a64e response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
95572024-11-15T21:54:25.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 826e6171-333c-4311-95f9-6a790d506dd7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95582024-11-15T21:54:25.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 826e6171-333c-4311-95f9-6a790d506dd7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95592024-11-15T21:54:25.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 826e6171-333c-4311-95f9-6a790d506dd7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95602024-11-15T21:54:26.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cb754205-4c47-4eb6-a0bf-7395148b6599 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95612024-11-15T21:54:26.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cb754205-4c47-4eb6-a0bf-7395148b6599 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95622024-11-15T21:54:26.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cb754205-4c47-4eb6-a0bf-7395148b6599 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95632024-11-15T21:54:27.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4244cbfa-5137-4344-b169-ba0e9b32d183 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95642024-11-15T21:54:27.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4244cbfa-5137-4344-b169-ba0e9b32d183 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95652024-11-15T21:54:27.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4244cbfa-5137-4344-b169-ba0e9b32d183 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95662024-11-15T21:54:28.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 90c7edae-8c77-4391-9b1a-e4561b682160 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95672024-11-15T21:54:28.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 90c7edae-8c77-4391-9b1a-e4561b682160 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95682024-11-15T21:54:28.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2616 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 90c7edae-8c77-4391-9b1a-e4561b682160 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95692024-11-15T21:54:29.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9477a06e-7786-4cba-b958-4e4b15c66a76 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95702024-11-15T21:54:29.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9477a06e-7786-4cba-b958-4e4b15c66a76 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95712024-11-15T21:54:29.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9477a06e-7786-4cba-b958-4e4b15c66a76 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95722024-11-15T21:54:30.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 23fc0954-9385-42ae-8845-7ac829b22afe roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95732024-11-15T21:54:30.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 23fc0954-9385-42ae-8845-7ac829b22afe resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95742024-11-15T21:54:30.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 23fc0954-9385-42ae-8845-7ac829b22afe response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95752024-11-15T21:54:30.676ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1427 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = ba2fc780-1070-4ef9-a00d-d0adb91753d5 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
95762024-11-15T21:54:31.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca1cf3da-7195-40e7-87c7-d87cb3d1b729 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95772024-11-15T21:54:31.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca1cf3da-7195-40e7-87c7-d87cb3d1b729 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95782024-11-15T21:54:31.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ca1cf3da-7195-40e7-87c7-d87cb3d1b729 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95792024-11-15T21:54:32.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b381ef94-7559-49ce-ba4e-ef727de2204f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95802024-11-15T21:54:32.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b381ef94-7559-49ce-ba4e-ef727de2204f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95812024-11-15T21:54:32.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b381ef94-7559-49ce-ba4e-ef727de2204f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
95822024-11-15T21:54:33.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
95832024-11-15T21:54:33.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95842024-11-15T21:54:33.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
95852024-11-15T21:54:33.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95862024-11-15T21:54:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95872024-11-15T21:54:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95882024-11-15T21:54:33.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95892024-11-15T21:54:33.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95902024-11-15T21:54:33.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95912024-11-15T21:54:33.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95922024-11-15T21:54:33.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95932024-11-15T21:54:33.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95942024-11-15T21:54:33.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95952024-11-15T21:54:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
95962024-11-15T21:54:33.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95972024-11-15T21:54:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95982024-11-15T21:54:33.058ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
95992024-11-15T21:54:33.058ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.65861ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
96002024-11-15T21:54:33.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96012024-11-15T21:54:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96022024-11-15T21:54:33.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.424696ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96032024-11-15T21:54:33.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e02c4de8-48bc-4a18-b862-fa866949c8e5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96042024-11-15T21:54:33.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e02c4de8-48bc-4a18-b862-fa866949c8e5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96052024-11-15T21:54:33.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e02c4de8-48bc-4a18-b862-fa866949c8e5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96062024-11-15T21:54:34.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9f752031-9d45-4f16-9b78-994b243fe912 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96072024-11-15T21:54:34.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9f752031-9d45-4f16-9b78-994b243fe912 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96082024-11-15T21:54:34.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9f752031-9d45-4f16-9b78-994b243fe912 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96092024-11-15T21:54:35.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 9b6db01b-7268-4870-a56a-6b9ae0d75ed3 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
96102024-11-15T21:54:35.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 9b6db01b-7268-4870-a56a-6b9ae0d75ed3 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
96112024-11-15T21:54:35.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 9b6db01b-7268-4870-a56a-6b9ae0d75ed3 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
96122024-11-15T21:54:35.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0d73726c-1809-41ba-9b31-606cb4780b34 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
96132024-11-15T21:54:35.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0d73726c-1809-41ba-9b31-606cb4780b34 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
96142024-11-15T21:54:35.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 0d73726c-1809-41ba-9b31-606cb4780b34 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
96152024-11-15T21:54:35.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 504d4461-ce50-436b-99fc-1ed0274d98b6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96162024-11-15T21:54:35.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 504d4461-ce50-436b-99fc-1ed0274d98b6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96172024-11-15T21:54:35.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 504d4461-ce50-436b-99fc-1ed0274d98b6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96182024-11-15T21:54:36.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e6905917-c7cc-4174-acd6-070b8ab8888d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96192024-11-15T21:54:36.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e6905917-c7cc-4174-acd6-070b8ab8888d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96202024-11-15T21:54:36.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e6905917-c7cc-4174-acd6-070b8ab8888d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96212024-11-15T21:54:37.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 610f69b9-09ae-4dd0-bdb3-e6815ed62bbf roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96222024-11-15T21:54:37.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 610f69b9-09ae-4dd0-bdb3-e6815ed62bbf resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96232024-11-15T21:54:37.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 610f69b9-09ae-4dd0-bdb3-e6815ed62bbf response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96242024-11-15T21:54:38.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 71d4cbf4-b5ed-4e63-91fe-a614fd740b49 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96252024-11-15T21:54:38.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 71d4cbf4-b5ed-4e63-91fe-a614fd740b49 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96262024-11-15T21:54:38.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 71d4cbf4-b5ed-4e63-91fe-a614fd740b49 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96272024-11-15T21:54:39.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cb987261-db98-4fbf-8ee9-394972d8e347 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96282024-11-15T21:54:39.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cb987261-db98-4fbf-8ee9-394972d8e347 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96292024-11-15T21:54:39.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cb987261-db98-4fbf-8ee9-394972d8e347 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96302024-11-15T21:54:40.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5af9b806-d190-47c5-a688-af6caf719f01 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96312024-11-15T21:54:40.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5af9b806-d190-47c5-a688-af6caf719f01 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96322024-11-15T21:54:40.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5af9b806-d190-47c5-a688-af6caf719f01 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96332024-11-15T21:54:41.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 492c5205-c805-44f6-8df5-424aed8d9773 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96342024-11-15T21:54:41.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 492c5205-c805-44f6-8df5-424aed8d9773 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96352024-11-15T21:54:41.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 492c5205-c805-44f6-8df5-424aed8d9773 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96362024-11-15T21:54:42.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a8295604-e675-44d2-8043-6a247d949124 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96372024-11-15T21:54:42.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a8295604-e675-44d2-8043-6a247d949124 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96382024-11-15T21:54:42.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a8295604-e675-44d2-8043-6a247d949124 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96392024-11-15T21:54:43.030ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
96402024-11-15T21:54:43.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
96412024-11-15T21:54:43.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96422024-11-15T21:54:43.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96432024-11-15T21:54:43.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96442024-11-15T21:54:43.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96452024-11-15T21:54:43.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96462024-11-15T21:54:43.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96472024-11-15T21:54:43.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96482024-11-15T21:54:43.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.730784ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96492024-11-15T21:54:43.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96502024-11-15T21:54:43.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96512024-11-15T21:54:43.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96522024-11-15T21:54:43.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96532024-11-15T21:54:43.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96542024-11-15T21:54:43.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96552024-11-15T21:54:43.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
96562024-11-15T21:54:43.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96572024-11-15T21:54:43.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96582024-11-15T21:54:43.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
96592024-11-15T21:54:43.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.606647ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
96602024-11-15T21:54:43.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c24b087a-0f54-45b2-9c99-913881ae1044 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96612024-11-15T21:54:43.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c24b087a-0f54-45b2-9c99-913881ae1044 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96622024-11-15T21:54:43.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c24b087a-0f54-45b2-9c99-913881ae1044 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96632024-11-15T21:54:44.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4022c0b7-c2d0-43b7-b6d5-db713965402c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96642024-11-15T21:54:44.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4022c0b7-c2d0-43b7-b6d5-db713965402c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96652024-11-15T21:54:44.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4022c0b7-c2d0-43b7-b6d5-db713965402c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96662024-11-15T21:54:45.673ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = fe0765c0-f113-4bfd-bb87-975579ccd049 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
96672024-11-15T21:54:45.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7169134-2535-40b5-bd5b-d999b57431bc roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96682024-11-15T21:54:45.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7169134-2535-40b5-bd5b-d999b57431bc resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96692024-11-15T21:54:45.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f7169134-2535-40b5-bd5b-d999b57431bc response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96702024-11-15T21:54:46.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b7b508b6-3d70-4884-a824-d4876294ce6d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96712024-11-15T21:54:46.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b7b508b6-3d70-4884-a824-d4876294ce6d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96722024-11-15T21:54:46.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b7b508b6-3d70-4884-a824-d4876294ce6d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96732024-11-15T21:54:47.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2c99bda2-4647-435a-9cd8-c8a604ace5a3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96742024-11-15T21:54:47.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2c99bda2-4647-435a-9cd8-c8a604ace5a3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96752024-11-15T21:54:47.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2c99bda2-4647-435a-9cd8-c8a604ace5a3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96762024-11-15T21:54:48.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 54f7477b-9128-42af-9ae9-768c718719d2 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96772024-11-15T21:54:48.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 54f7477b-9128-42af-9ae9-768c718719d2 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96782024-11-15T21:54:48.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 54f7477b-9128-42af-9ae9-768c718719d2 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96792024-11-15T21:54:50.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d6ff45cb-585c-4b5b-92f3-afdf48e16dce roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96802024-11-15T21:54:50.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d6ff45cb-585c-4b5b-92f3-afdf48e16dce resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96812024-11-15T21:54:50.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d6ff45cb-585c-4b5b-92f3-afdf48e16dce response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96822024-11-15T21:54:50.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 86d7868e-05a8-433e-910b-90519de3ca46 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
96832024-11-15T21:54:50.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 86d7868e-05a8-433e-910b-90519de3ca46 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
96842024-11-15T21:54:50.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 86d7868e-05a8-433e-910b-90519de3ca46 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
96852024-11-15T21:54:50.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = a7531e7b-06f0-4046-bd38-d9c7890bf450 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
96862024-11-15T21:54:50.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = a7531e7b-06f0-4046-bd38-d9c7890bf450 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
96872024-11-15T21:54:50.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = a7531e7b-06f0-4046-bd38-d9c7890bf450 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
96882024-11-15T21:54:51.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 55f0892e-3d0b-4097-88f2-fb7d3ddc148f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96892024-11-15T21:54:51.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 55f0892e-3d0b-4097-88f2-fb7d3ddc148f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96902024-11-15T21:54:51.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 55f0892e-3d0b-4097-88f2-fb7d3ddc148f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96912024-11-15T21:54:52.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 901ebebd-143e-404a-b9c1-24e532ab7645 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96922024-11-15T21:54:52.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 901ebebd-143e-404a-b9c1-24e532ab7645 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96932024-11-15T21:54:52.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 901ebebd-143e-404a-b9c1-24e532ab7645 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
96942024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
96952024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
96962024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96972024-11-15T21:54:53.030ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96982024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
96992024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97002024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97012024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
97022024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97032024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
97042024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
97052024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97062024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
97072024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97082024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
97092024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
97102024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97112024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97122024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
97132024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97142024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97152024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
97162024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
97172024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97182024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97192024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
97202024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97212024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
97222024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
97232024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97242024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97252024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
97262024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
97272024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
97282024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97292024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97302024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97312024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97322024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97332024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97342024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97352024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97362024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97372024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97382024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97392024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97402024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97412024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97422024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97432024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97442024-11-15T21:54:53.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97452024-11-15T21:54:53.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97462024-11-15T21:54:53.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97472024-11-15T21:54:53.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97482024-11-15T21:54:53.033ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.815555ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97492024-11-15T21:54:53.034ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1774, tv_nsec: 977466560 } })
97502024-11-15T21:54:53.034ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97512024-11-15T21:54:53.034ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97522024-11-15T21:54:53.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97532024-11-15T21:54:53.034ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
97542024-11-15T21:54:53.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97552024-11-15T21:54:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97562024-11-15T21:54:53.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97572024-11-15T21:54:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97582024-11-15T21:54:53.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97592024-11-15T21:54:53.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97602024-11-15T21:54:53.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.479379ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
97612024-11-15T21:54:53.037ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97622024-11-15T21:54:53.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97632024-11-15T21:54:53.038ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.107353ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
97642024-11-15T21:54:53.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97652024-11-15T21:54:53.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97662024-11-15T21:54:53.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97672024-11-15T21:54:53.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97682024-11-15T21:54:53.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97692024-11-15T21:54:53.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97702024-11-15T21:54:53.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97712024-11-15T21:54:53.042ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1774, tv_nsec: 985632813 } })
97722024-11-15T21:54:53.042ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
97732024-11-15T21:54:53.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97742024-11-15T21:54:53.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97752024-11-15T21:54:53.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97762024-11-15T21:54:53.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97772024-11-15T21:54:53.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97782024-11-15T21:54:53.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97792024-11-15T21:54:53.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97802024-11-15T21:54:53.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97812024-11-15T21:54:53.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97822024-11-15T21:54:53.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97832024-11-15T21:54:53.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97842024-11-15T21:54:53.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97852024-11-15T21:54:53.046ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97862024-11-15T21:54:53.046ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97872024-11-15T21:54:53.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97882024-11-15T21:54:53.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97892024-11-15T21:54:53.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97902024-11-15T21:54:53.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97912024-11-15T21:54:53.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97922024-11-15T21:54:53.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97932024-11-15T21:54:53.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97942024-11-15T21:54:53.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97952024-11-15T21:54:53.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97962024-11-15T21:54:53.049ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1774, tv_nsec: 993035741 } })
97972024-11-15T21:54:53.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97982024-11-15T21:54:53.050ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
97992024-11-15T21:54:53.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98002024-11-15T21:54:53.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98012024-11-15T21:54:53.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98022024-11-15T21:54:53.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98032024-11-15T21:54:53.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98042024-11-15T21:54:53.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98052024-11-15T21:54:53.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98062024-11-15T21:54:53.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98072024-11-15T21:54:53.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98082024-11-15T21:54:53.058ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98092024-11-15T21:54:53.058ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.690026ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98102024-11-15T21:54:53.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98112024-11-15T21:54:53.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98122024-11-15T21:54:53.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98132024-11-15T21:54:53.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98142024-11-15T21:54:53.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.370008ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98152024-11-15T21:54:53.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98162024-11-15T21:54:53.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 60.137231ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
98172024-11-15T21:54:53.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98182024-11-15T21:54:53.091ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98192024-11-15T21:54:53.091ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98202024-11-15T21:54:53.091ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 61.744191ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98212024-11-15T21:54:53.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98222024-11-15T21:54:53.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98232024-11-15T21:54:53.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
98242024-11-15T21:54:53.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98252024-11-15T21:54:53.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98262024-11-15T21:54:53.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.019975ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
98272024-11-15T21:54:53.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
98282024-11-15T21:54:53.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98292024-11-15T21:54:53.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98302024-11-15T21:54:53.095ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.819947ms iteration = 26 status = 0
98312024-11-15T21:54:53.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.300707ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98322024-11-15T21:54:53.103ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
98332024-11-15T21:54:53.103ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.341867ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
98342024-11-15T21:54:53.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98352024-11-15T21:54:53.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98362024-11-15T21:54:53.149ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
98372024-11-15T21:54:53.149ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98382024-11-15T21:54:53.150ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c27003d-1db0-4efe-9b92-e29c0f408a14", "content-length": "26", "date": "Fri, 15 Nov 2024 21:54:52 GMT"} })
98392024-11-15T21:54:53.150ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98402024-11-15T21:54:53.152ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
98412024-11-15T21:54:53.161ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.620214ms iteration = 30 status = {"physical_disks_added":0}
98422024-11-15T21:54:53.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 61a1e824-8c52-4f4b-bb01-235918626e9e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
98432024-11-15T21:54:53.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 61a1e824-8c52-4f4b-bb01-235918626e9e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
98442024-11-15T21:54:53.193ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
98452024-11-15T21:54:53.193ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98462024-11-15T21:54:53.193ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e59ed54f-4a09-44a9-86c4-f41e3c9cde9a", "content-length": "26", "date": "Fri, 15 Nov 2024 21:54:52 GMT"} })
98472024-11-15T21:54:53.193ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98482024-11-15T21:54:53.194ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98492024-11-15T21:54:53.225ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98502024-11-15T21:54:53.225ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98512024-11-15T21:54:53.226ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
98522024-11-15T21:54:53.226ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98532024-11-15T21:54:53.227ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d76bc185-b95e-4e35-a9dd-63e67b89ce81", "content-length": "26", "date": "Fri, 15 Nov 2024 21:54:52 GMT"} })
98542024-11-15T21:54:53.227ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98552024-11-15T21:54:53.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 61a1e824-8c52-4f4b-bb01-235918626e9e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
98562024-11-15T21:54:53.229ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98572024-11-15T21:54:53.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98582024-11-15T21:54:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98592024-11-15T21:54:53.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98602024-11-15T21:54:53.239ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98612024-11-15T21:54:53.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98622024-11-15T21:54:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98632024-11-15T21:54:53.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98642024-11-15T21:54:53.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98652024-11-15T21:54:53.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98662024-11-15T21:54:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98672024-11-15T21:54:53.275ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98682024-11-15T21:54:53.276ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6726b190-433b-43f3-ab88-d3c679f188d2", "content-length": "2", "date": "Fri, 15 Nov 2024 21:54:53 GMT"} })
98692024-11-15T21:54:53.278ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98702024-11-15T21:54:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98712024-11-15T21:54:53.280ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.428645ms iteration = 26 status = null
98722024-11-15T21:54:53.310ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0065677b-b245-426c-abae-ea5d4f47ef56", "content-length": "372", "date": "Fri, 15 Nov 2024 21:54:53 GMT"} })
98732024-11-15T21:54:53.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98742024-11-15T21:54:53.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98752024-11-15T21:54:53.314ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 284.339356ms iteration = 26 status = {}
98762024-11-15T21:54:53.320ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98772024-11-15T21:54:53.320ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c124dbe-91ba-40a7-aee2-3495f143e7fd", "content-length": "691", "date": "Fri, 15 Nov 2024 21:54:53 GMT"} })
98782024-11-15T21:54:53.320ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
98792024-11-15T21:54:53.320ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
98802024-11-15T21:54:53.320ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
98812024-11-15T21:54:53.322ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 292.934671ms iteration = 27 status = {}
98822024-11-15T21:54:53.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98832024-11-15T21:54:53.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98842024-11-15T21:54:53.356ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
98852024-11-15T21:54:53.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98862024-11-15T21:54:53.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98872024-11-15T21:54:53.359ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
98882024-11-15T21:54:53.359ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98892024-11-15T21:54:53.360ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1da8a056-6c49-431a-86e7-6359d409d9b9", "date": "Fri, 15 Nov 2024 21:54:53 GMT"} })
98902024-11-15T21:54:53.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98912024-11-15T21:54:53.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98922024-11-15T21:54:53.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98932024-11-15T21:54:53.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98942024-11-15T21:54:53.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98952024-11-15T21:54:53.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98962024-11-15T21:54:53.367ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
98972024-11-15T21:54:53.367ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cae4d69-eaf2-4d80-9861-2bdfc28c6069", "content-length": "134", "date": "Fri, 15 Nov 2024 21:54:53 GMT"} })
98982024-11-15T21:54:53.367ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
98992024-11-15T21:54:53.367ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
99002024-11-15T21:54:53.367ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99012024-11-15T21:54:53.367ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99022024-11-15T21:54:53.367ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99032024-11-15T21:54:53.367ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99042024-11-15T21:54:53.367ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99052024-11-15T21:54:53.367ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99062024-11-15T21:54:53.367ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99072024-11-15T21:54:53.367ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99082024-11-15T21:54:53.368ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
99092024-11-15T21:54:53.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99102024-11-15T21:54:53.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99112024-11-15T21:54:53.368ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99122024-11-15T21:54:53.368ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99132024-11-15T21:54:53.368ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1e97116f-4a35-4f74-8899-a45702a86ea1", "date": "Fri, 15 Nov 2024 21:54:53 GMT"} })
99142024-11-15T21:54:53.369ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99152024-11-15T21:54:53.369ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "372979f4-13e9-4cdd-8616-bb2a04b813af", "content-length": "2", "date": "Fri, 15 Nov 2024 21:54:53 GMT"} })
99162024-11-15T21:54:53.369ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99172024-11-15T21:54:53.369ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "429b949d-db14-4343-986d-f5f84067eed4", "content-length": "52", "date": "Fri, 15 Nov 2024 21:54:53 GMT"} })
99182024-11-15T21:54:53.369ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
99192024-11-15T21:54:53.369ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99202024-11-15T21:54:53.371ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 341.095074ms iteration = 28 status = {}
99212024-11-15T21:54:53.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1ab255ca-f138-4f2a-877e-e12626f8e52d", "date": "Fri, 15 Nov 2024 21:54:53 GMT"} })
99222024-11-15T21:54:53.452ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
99232024-11-15T21:54:53.452ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99242024-11-15T21:54:53.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b351a103-534f-4ab3-9ad3-b519385f006a", "content-length": "682", "date": "Fri, 15 Nov 2024 21:54:53 GMT"} })
99252024-11-15T21:54:53.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99262024-11-15T21:54:53.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99272024-11-15T21:54:53.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99282024-11-15T21:54:53.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99292024-11-15T21:54:53.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99302024-11-15T21:54:53.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99312024-11-15T21:54:53.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99322024-11-15T21:54:53.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99332024-11-15T21:54:53.469ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 439.411753ms iteration = 26 status = {}
99342024-11-15T21:54:54.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2ac9c2bb-af0c-455c-87e2-8e3f7b2d4191 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99352024-11-15T21:54:54.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2ac9c2bb-af0c-455c-87e2-8e3f7b2d4191 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99362024-11-15T21:54:54.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2ac9c2bb-af0c-455c-87e2-8e3f7b2d4191 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99372024-11-15T21:54:54.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 18e2e4ba-487b-436f-bbf4-d6bdf85c8bd6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
99382024-11-15T21:54:54.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 18e2e4ba-487b-436f-bbf4-d6bdf85c8bd6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
99392024-11-15T21:54:54.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 18e2e4ba-487b-436f-bbf4-d6bdf85c8bd6 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
99402024-11-15T21:54:55.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3802cd36-20ab-4cb7-b665-0f8d1c1a908a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99412024-11-15T21:54:55.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3802cd36-20ab-4cb7-b665-0f8d1c1a908a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99422024-11-15T21:54:55.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3802cd36-20ab-4cb7-b665-0f8d1c1a908a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99432024-11-15T21:54:56.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4a33f036-4d83-4b9c-ac09-3d220f1c99ae roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99442024-11-15T21:54:56.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4a33f036-4d83-4b9c-ac09-3d220f1c99ae resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99452024-11-15T21:54:56.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4a33f036-4d83-4b9c-ac09-3d220f1c99ae response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99462024-11-15T21:54:57.191ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
99472024-11-15T21:54:57.191ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
99482024-11-15T21:54:57.221ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
99492024-11-15T21:54:57.221ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:64400
99502024-11-15T21:54:57.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:64400 req_id = 2beeda91-f821-4fe3-9333-f9b51efb6a2e roles = RoleSet { roles: {} } uri = /metrics/producers
99512024-11-15T21:54:57.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:64400 req_id = 2beeda91-f821-4fe3-9333-f9b51efb6a2e resource = Database result = Ok(()) uri = /metrics/producers
99522024-11-15T21:54:57.257ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
99532024-11-15T21:54:57.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36108 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:64400 req_id = 2beeda91-f821-4fe3-9333-f9b51efb6a2e response_code = 201 uri = /metrics/producers
99542024-11-15T21:54:57.257ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2beeda91-f821-4fe3-9333-f9b51efb6a2e", "content-length": "41", "date": "Fri, 15 Nov 2024 21:54:57 GMT"} })
99552024-11-15T21:54:57.260ZDEBGnexus (producer-registration-task): registered with nexus successfully
99562024-11-15T21:54:57.260ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
99572024-11-15T21:54:57.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 297dc3f4-fe38-48d9-ac98-0cd2c44314df roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99582024-11-15T21:54:57.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 297dc3f4-fe38-48d9-ac98-0cd2c44314df resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99592024-11-15T21:54:57.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 297dc3f4-fe38-48d9-ac98-0cd2c44314df response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99602024-11-15T21:54:58.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 36f65e9a-3409-4bb7-bb67-60846adfde77 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99612024-11-15T21:54:58.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 36f65e9a-3409-4bb7-bb67-60846adfde77 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99622024-11-15T21:54:58.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1796 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 36f65e9a-3409-4bb7-bb67-60846adfde77 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99632024-11-15T21:54:59.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 79b596ee-bf1c-4f93-96e4-e9614534c2db roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99642024-11-15T21:54:59.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 79b596ee-bf1c-4f93-96e4-e9614534c2db resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99652024-11-15T21:54:59.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 79b596ee-bf1c-4f93-96e4-e9614534c2db response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99662024-11-15T21:55:00.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 61a16975-d0a6-453f-8361-33f79ccb6361 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99672024-11-15T21:55:00.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 61a16975-d0a6-453f-8361-33f79ccb6361 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99682024-11-15T21:55:00.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 61a16975-d0a6-453f-8361-33f79ccb6361 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99692024-11-15T21:55:00.668ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1306 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 558c4b4c-35b5-43f7-bf7b-7e8a8ea86689 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
99702024-11-15T21:55:01.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2d17dd0a-13b0-411a-a609-c76c01dd02f8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99712024-11-15T21:55:01.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2d17dd0a-13b0-411a-a609-c76c01dd02f8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99722024-11-15T21:55:01.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2d17dd0a-13b0-411a-a609-c76c01dd02f8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99732024-11-15T21:55:02.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1104b034-f088-44b6-a9f4-25662337d022 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99742024-11-15T21:55:02.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1104b034-f088-44b6-a9f4-25662337d022 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99752024-11-15T21:55:02.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1104b034-f088-44b6-a9f4-25662337d022 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99762024-11-15T21:55:03.026ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
99772024-11-15T21:55:03.026ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99782024-11-15T21:55:03.026ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
99792024-11-15T21:55:03.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99802024-11-15T21:55:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99812024-11-15T21:55:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99822024-11-15T21:55:03.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99832024-11-15T21:55:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99842024-11-15T21:55:03.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99852024-11-15T21:55:03.030ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.204247ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99862024-11-15T21:55:03.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99872024-11-15T21:55:03.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99882024-11-15T21:55:03.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99892024-11-15T21:55:03.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99902024-11-15T21:55:03.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99912024-11-15T21:55:03.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99922024-11-15T21:55:03.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
99932024-11-15T21:55:03.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99942024-11-15T21:55:03.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99952024-11-15T21:55:03.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
99962024-11-15T21:55:03.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.714467ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
99972024-11-15T21:55:03.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9ebf803-109c-4945-8593-8693fd3502eb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99982024-11-15T21:55:03.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9ebf803-109c-4945-8593-8693fd3502eb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
99992024-11-15T21:55:03.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9ebf803-109c-4945-8593-8693fd3502eb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100002024-11-15T21:55:04.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3f1fbc34-3e8b-49c3-aa53-41e2d931bd7f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100012024-11-15T21:55:04.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3f1fbc34-3e8b-49c3-aa53-41e2d931bd7f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100022024-11-15T21:55:04.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3f1fbc34-3e8b-49c3-aa53-41e2d931bd7f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100032024-11-15T21:55:05.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 45ac5701-f9f6-4819-93a7-a2eb1d4ef771 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100042024-11-15T21:55:05.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 45ac5701-f9f6-4819-93a7-a2eb1d4ef771 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100052024-11-15T21:55:05.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 45ac5701-f9f6-4819-93a7-a2eb1d4ef771 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100062024-11-15T21:55:06.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 08706e91-ca71-4c86-8a59-e667450d0b0f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100072024-11-15T21:55:06.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 08706e91-ca71-4c86-8a59-e667450d0b0f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100082024-11-15T21:55:06.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 08706e91-ca71-4c86-8a59-e667450d0b0f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100092024-11-15T21:55:07.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0f9176c1-c39a-4e5b-b8a7-7d670452b86f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100102024-11-15T21:55:07.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0f9176c1-c39a-4e5b-b8a7-7d670452b86f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100112024-11-15T21:55:07.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0f9176c1-c39a-4e5b-b8a7-7d670452b86f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100122024-11-15T21:55:08.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 411bb952-30db-46a4-8e2b-c7f4145848c6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100132024-11-15T21:55:08.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 411bb952-30db-46a4-8e2b-c7f4145848c6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100142024-11-15T21:55:08.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 411bb952-30db-46a4-8e2b-c7f4145848c6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100152024-11-15T21:55:08.972ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46791
100162024-11-15T21:55:08.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46791 req_id = e231232e-680e-4ec6-bcdf-18c9687e1299 roles = RoleSet { roles: {} } uri = /metrics/producers
100172024-11-15T21:55:08.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46791 req_id = e231232e-680e-4ec6-bcdf-18c9687e1299 resource = Database result = Ok(()) uri = /metrics/producers
100182024-11-15T21:55:09.007ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 5e8fa613-d1c4-416c-8557-742a109ff40b
100192024-11-15T21:55:09.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35024 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46791 req_id = e231232e-680e-4ec6-bcdf-18c9687e1299 response_code = 201 uri = /metrics/producers
100202024-11-15T21:55:09.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 32c9cff6-2a9e-47f8-be82-977baea364f6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100212024-11-15T21:55:09.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 32c9cff6-2a9e-47f8-be82-977baea364f6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100222024-11-15T21:55:09.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 32c9cff6-2a9e-47f8-be82-977baea364f6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100232024-11-15T21:55:10.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f5413f10-1f38-4bab-9205-72f300c57e0a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100242024-11-15T21:55:10.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f5413f10-1f38-4bab-9205-72f300c57e0a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100252024-11-15T21:55:10.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f5413f10-1f38-4bab-9205-72f300c57e0a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100262024-11-15T21:55:11.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 09ac6ab2-ec4d-4129-a9a7-4b9c702cd203 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100272024-11-15T21:55:11.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 09ac6ab2-ec4d-4129-a9a7-4b9c702cd203 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100282024-11-15T21:55:11.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 09ac6ab2-ec4d-4129-a9a7-4b9c702cd203 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100292024-11-15T21:55:12.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7bf0a542-fdf2-4534-9a81-d4730e6cd6b3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100302024-11-15T21:55:12.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7bf0a542-fdf2-4534-9a81-d4730e6cd6b3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100312024-11-15T21:55:12.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7bf0a542-fdf2-4534-9a81-d4730e6cd6b3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100322024-11-15T21:55:13.026ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
100332024-11-15T21:55:13.026ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
100342024-11-15T21:55:13.026ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100352024-11-15T21:55:13.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100362024-11-15T21:55:13.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100372024-11-15T21:55:13.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100382024-11-15T21:55:13.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100392024-11-15T21:55:13.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100402024-11-15T21:55:13.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100412024-11-15T21:55:13.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100422024-11-15T21:55:13.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100432024-11-15T21:55:13.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100442024-11-15T21:55:13.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100452024-11-15T21:55:13.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
100462024-11-15T21:55:13.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100472024-11-15T21:55:13.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100482024-11-15T21:55:13.046ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
100492024-11-15T21:55:13.046ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.11001ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
100502024-11-15T21:55:13.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100512024-11-15T21:55:13.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100522024-11-15T21:55:13.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.34356ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100532024-11-15T21:55:13.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3de61feb-f81a-416a-b8fd-2fda7263547f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100542024-11-15T21:55:13.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3de61feb-f81a-416a-b8fd-2fda7263547f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100552024-11-15T21:55:13.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2722 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3de61feb-f81a-416a-b8fd-2fda7263547f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100562024-11-15T21:55:14.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 86d2de6d-005a-4875-bd0b-fb492bef1ea3 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100572024-11-15T21:55:14.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 86d2de6d-005a-4875-bd0b-fb492bef1ea3 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100582024-11-15T21:55:14.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 86d2de6d-005a-4875-bd0b-fb492bef1ea3 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100592024-11-15T21:55:15.669ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1478 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 801165bc-19ba-4372-a491-5b51f7b8fba0 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
100602024-11-15T21:55:15.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b147a1a8-738c-444e-83db-9e163cceada4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100612024-11-15T21:55:15.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b147a1a8-738c-444e-83db-9e163cceada4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100622024-11-15T21:55:15.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b147a1a8-738c-444e-83db-9e163cceada4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100632024-11-15T21:55:16.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2e2ae233-18e3-4c4c-bf5c-09c11b63945f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100642024-11-15T21:55:16.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2e2ae233-18e3-4c4c-bf5c-09c11b63945f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100652024-11-15T21:55:16.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2e2ae233-18e3-4c4c-bf5c-09c11b63945f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100662024-11-15T21:55:16.995ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:54082
100672024-11-15T21:55:16.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54082 req_id = 76368463-12c8-4fb3-ac15-e796a9fb70e9 roles = RoleSet { roles: {} } uri = /metrics/producers
100682024-11-15T21:55:16.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54082 req_id = 76368463-12c8-4fb3-ac15-e796a9fb70e9 resource = Database result = Ok(()) uri = /metrics/producers
100692024-11-15T21:55:17.006ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 78d47478-5af8-488d-89c5-11be23443b63
100702024-11-15T21:55:17.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10859 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54082 req_id = 76368463-12c8-4fb3-ac15-e796a9fb70e9 response_code = 201 uri = /metrics/producers
100712024-11-15T21:55:17.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2a5360ed-a42d-4c5e-bf5f-b3846d6af29f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100722024-11-15T21:55:17.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2a5360ed-a42d-4c5e-bf5f-b3846d6af29f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100732024-11-15T21:55:17.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2a5360ed-a42d-4c5e-bf5f-b3846d6af29f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100742024-11-15T21:55:18.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 26a92d77-d831-46a3-a37a-469413de451d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100752024-11-15T21:55:18.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 26a92d77-d831-46a3-a37a-469413de451d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100762024-11-15T21:55:18.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 26a92d77-d831-46a3-a37a-469413de451d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100772024-11-15T21:55:19.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fa501d89-1756-440e-8d01-f5b14774749f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100782024-11-15T21:55:19.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fa501d89-1756-440e-8d01-f5b14774749f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100792024-11-15T21:55:19.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fa501d89-1756-440e-8d01-f5b14774749f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100802024-11-15T21:55:20.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0cca8252-13a3-43ce-a791-d56699e3e112 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100812024-11-15T21:55:20.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0cca8252-13a3-43ce-a791-d56699e3e112 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100822024-11-15T21:55:20.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0cca8252-13a3-43ce-a791-d56699e3e112 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100832024-11-15T21:55:21.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 357ea150-17d8-4f68-8892-bdaa37db707b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100842024-11-15T21:55:21.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 357ea150-17d8-4f68-8892-bdaa37db707b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100852024-11-15T21:55:21.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 357ea150-17d8-4f68-8892-bdaa37db707b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100862024-11-15T21:55:22.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e9accb79-877d-4c36-b690-422cb2ea030e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100872024-11-15T21:55:22.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e9accb79-877d-4c36-b690-422cb2ea030e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100882024-11-15T21:55:22.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e9accb79-877d-4c36-b690-422cb2ea030e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
100892024-11-15T21:55:23.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
100902024-11-15T21:55:23.027ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
100912024-11-15T21:55:23.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100922024-11-15T21:55:23.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
100932024-11-15T21:55:23.027ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
100942024-11-15T21:55:23.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100952024-11-15T21:55:23.027ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
100962024-11-15T21:55:23.027ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
100972024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100982024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100992024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
101002024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
101012024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101022024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
101032024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
101042024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101052024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
101062024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
101072024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101082024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
101092024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101102024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
101112024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
101122024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101132024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
101142024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
101152024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
101162024-11-15T21:55:23.028ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
101172024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
101182024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101192024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
101202024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101212024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
101222024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101232024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
101242024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
101252024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
101262024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101272024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
101282024-11-15T21:55:23.028ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101292024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101302024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
101312024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101322024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
101332024-11-15T21:55:23.028ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:45:23.028240181 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
101342024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
101352024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
101362024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
101372024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101382024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
101392024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
101402024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101412024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101422024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101432024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101442024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
101452024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101462024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
101472024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101482024-11-15T21:55:23.028ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
101492024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
101502024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.4\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
101512024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101522024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101532024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101542024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101552024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
101562024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101572024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101582024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101592024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
101602024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
101612024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101622024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101632024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101642024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101652024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101662024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101672024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
101682024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
101692024-11-15T21:55:23.028ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1804, tv_nsec: 974316636 } })
101702024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101712024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101722024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101732024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101742024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
101752024-11-15T21:55:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101762024-11-15T21:55:23.028ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1804, tv_nsec: 974377827 } })
101772024-11-15T21:55:23.029ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
101782024-11-15T21:55:23.029ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.387669ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
101792024-11-15T21:55:23.029ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
101802024-11-15T21:55:23.029ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.406029ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
101812024-11-15T21:55:23.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101822024-11-15T21:55:23.031ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.277322ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101832024-11-15T21:55:23.031ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101842024-11-15T21:55:23.032ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1804, tv_nsec: 977982610 } })
101852024-11-15T21:55:23.032ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
101862024-11-15T21:55:23.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101872024-11-15T21:55:23.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101882024-11-15T21:55:23.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101892024-11-15T21:55:23.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101902024-11-15T21:55:23.034ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101912024-11-15T21:55:23.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101922024-11-15T21:55:23.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101932024-11-15T21:55:23.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101942024-11-15T21:55:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101952024-11-15T21:55:23.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101962024-11-15T21:55:23.037ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.382571ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
101972024-11-15T21:55:23.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101982024-11-15T21:55:23.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101992024-11-15T21:55:23.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102002024-11-15T21:55:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102012024-11-15T21:55:23.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102022024-11-15T21:55:23.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102032024-11-15T21:55:23.040ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.396241ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
102042024-11-15T21:55:23.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102052024-11-15T21:55:23.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102062024-11-15T21:55:23.043ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102072024-11-15T21:55:23.043ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1804, tv_nsec: 989305044 } })
102082024-11-15T21:55:23.044ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
102092024-11-15T21:55:23.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
102102024-11-15T21:55:23.045ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
102112024-11-15T21:55:23.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
102122024-11-15T21:55:23.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102132024-11-15T21:55:23.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102142024-11-15T21:55:23.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102152024-11-15T21:55:23.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102162024-11-15T21:55:23.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102172024-11-15T21:55:23.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102182024-11-15T21:55:23.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102192024-11-15T21:55:23.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102202024-11-15T21:55:23.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102212024-11-15T21:55:23.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102222024-11-15T21:55:23.052ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:45:23.028240181 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
102232024-11-15T21:55:23.052ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 23.902666ms iteration = 14 status = {"expiration":"2024-11-15T21:45:23.028240181Z","pruned":[]}
102242024-11-15T21:55:23.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102252024-11-15T21:55:23.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102262024-11-15T21:55:23.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102272024-11-15T21:55:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102282024-11-15T21:55:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102292024-11-15T21:55:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102302024-11-15T21:55:23.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102312024-11-15T21:55:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102322024-11-15T21:55:23.054ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102332024-11-15T21:55:23.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102342024-11-15T21:55:23.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102352024-11-15T21:55:23.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102362024-11-15T21:55:23.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102372024-11-15T21:55:23.056ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1805, tv_nsec: 2075836 } })
102382024-11-15T21:55:23.056ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
102392024-11-15T21:55:23.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102402024-11-15T21:55:23.057ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102412024-11-15T21:55:23.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102422024-11-15T21:55:23.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102432024-11-15T21:55:23.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102442024-11-15T21:55:23.060ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
102452024-11-15T21:55:23.060ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
102462024-11-15T21:55:23.060ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
102472024-11-15T21:55:23.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102482024-11-15T21:55:23.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102492024-11-15T21:55:23.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102502024-11-15T21:55:23.062ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102512024-11-15T21:55:23.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102522024-11-15T21:55:23.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102532024-11-15T21:55:23.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102542024-11-15T21:55:23.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
102552024-11-15T21:55:23.067ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102562024-11-15T21:55:23.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102572024-11-15T21:55:23.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102582024-11-15T21:55:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102592024-11-15T21:55:23.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102602024-11-15T21:55:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102612024-11-15T21:55:23.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.095917ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
102622024-11-15T21:55:23.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102632024-11-15T21:55:23.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102642024-11-15T21:55:23.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102652024-11-15T21:55:23.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102662024-11-15T21:55:23.098ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102672024-11-15T21:55:23.098ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102682024-11-15T21:55:23.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102692024-11-15T21:55:23.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102702024-11-15T21:55:23.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102712024-11-15T21:55:23.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102722024-11-15T21:55:23.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102732024-11-15T21:55:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102742024-11-15T21:55:23.102ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
102752024-11-15T21:55:23.102ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
102762024-11-15T21:55:23.102ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.620624ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
102772024-11-15T21:55:23.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102782024-11-15T21:55:23.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102792024-11-15T21:55:23.109ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
102802024-11-15T21:55:23.109ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
102812024-11-15T21:55:23.109ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.650281ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
102822024-11-15T21:55:23.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
102832024-11-15T21:55:23.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102842024-11-15T21:55:23.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102852024-11-15T21:55:23.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.31303ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102862024-11-15T21:55:23.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102872024-11-15T21:55:23.112ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.806115ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102882024-11-15T21:55:23.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102892024-11-15T21:55:23.112ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102902024-11-15T21:55:23.112ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.736941ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102912024-11-15T21:55:23.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102922024-11-15T21:55:23.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102932024-11-15T21:55:23.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102942024-11-15T21:55:23.122ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
102952024-11-15T21:55:23.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102962024-11-15T21:55:23.146ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
102972024-11-15T21:55:23.146ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
102982024-11-15T21:55:23.146ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
102992024-11-15T21:55:23.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103002024-11-15T21:55:23.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103012024-11-15T21:55:23.179ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
103022024-11-15T21:55:23.200ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
103032024-11-15T21:55:23.200ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103042024-11-15T21:55:23.201ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "441c5eb2-d75f-4381-b90c-9b5fa9a37a64", "content-length": "26", "date": "Fri, 15 Nov 2024 21:55:22 GMT"} })
103052024-11-15T21:55:23.201ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103062024-11-15T21:55:23.202ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103072024-11-15T21:55:23.229ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
103082024-11-15T21:55:23.229ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103092024-11-15T21:55:23.229ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c5bb886-1e68-4ac6-9a2a-70b1994a7b8b", "content-length": "26", "date": "Fri, 15 Nov 2024 21:55:22 GMT"} })
103102024-11-15T21:55:23.229ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103112024-11-15T21:55:23.230ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
103122024-11-15T21:55:23.230ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103132024-11-15T21:55:23.230ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "55001198-5bed-4977-a1f8-7e13235b54bf", "content-length": "26", "date": "Fri, 15 Nov 2024 21:55:22 GMT"} })
103142024-11-15T21:55:23.230ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103152024-11-15T21:55:23.232ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
103162024-11-15T21:55:23.233ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103172024-11-15T21:55:23.256ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
103182024-11-15T21:55:23.347ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
103192024-11-15T21:55:23.348ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7647669c-3df8-46f0-9119-f4b4f7884f2a", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103202024-11-15T21:55:23.348ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103212024-11-15T21:55:23.350ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e95b002b-db99-4be3-84da-5af3833584ce", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103222024-11-15T21:55:23.350ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103232024-11-15T21:55:23.351ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103242024-11-15T21:55:23.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 323.639941ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
103252024-11-15T21:55:23.369ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103262024-11-15T21:55:23.369ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6be5404-b26c-4d97-b9ce-66cc5f850156", "content-length": "2", "date": "Fri, 15 Nov 2024 21:55:22 GMT"} })
103272024-11-15T21:55:23.371ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103282024-11-15T21:55:23.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103292024-11-15T21:55:23.376ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103302024-11-15T21:55:23.376ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103312024-11-15T21:55:23.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103322024-11-15T21:55:23.381ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103332024-11-15T21:55:23.381ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
103342024-11-15T21:55:23.381ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103352024-11-15T21:55:23.382ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103362024-11-15T21:55:23.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103372024-11-15T21:55:23.382ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103382024-11-15T21:55:23.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103392024-11-15T21:55:23.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103402024-11-15T21:55:23.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103412024-11-15T21:55:23.384ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103422024-11-15T21:55:23.385ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 358.147915ms iteration = 27 status = null
103432024-11-15T21:55:23.387ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "491c2564-3f56-4971-a37d-2577ed83994e", "content-length": "372", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} })
103442024-11-15T21:55:23.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103452024-11-15T21:55:23.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103462024-11-15T21:55:23.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
103472024-11-15T21:55:23.389ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103482024-11-15T21:55:23.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103492024-11-15T21:55:23.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103502024-11-15T21:55:23.391ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 363.64378ms iteration = 27 status = {}
103512024-11-15T21:55:23.393ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103522024-11-15T21:55:23.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103532024-11-15T21:55:23.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103542024-11-15T21:55:23.395ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
103552024-11-15T21:55:23.395ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 367.776217ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
103562024-11-15T21:55:23.411ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 383.212867ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
103572024-11-15T21:55:23.411ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103582024-11-15T21:55:23.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103592024-11-15T21:55:23.412ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103602024-11-15T21:55:23.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103612024-11-15T21:55:23.412ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
103622024-11-15T21:55:23.412ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
103632024-11-15T21:55:23.412ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103642024-11-15T21:55:23.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103652024-11-15T21:55:23.413ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103662024-11-15T21:55:23.413ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103672024-11-15T21:55:23.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
103682024-11-15T21:55:23.416ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103692024-11-15T21:55:23.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103702024-11-15T21:55:23.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103712024-11-15T21:55:23.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103722024-11-15T21:55:23.419ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103732024-11-15T21:55:23.419ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103742024-11-15T21:55:23.419ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 391.30847ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103752024-11-15T21:55:23.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103762024-11-15T21:55:23.420ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103772024-11-15T21:55:23.421ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
103782024-11-15T21:55:23.421ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
103792024-11-15T21:55:23.421ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
103802024-11-15T21:55:23.421ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 394.020588ms iteration = 15 status = {"generation":1}
103812024-11-15T21:55:23.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
103822024-11-15T21:55:23.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103832024-11-15T21:55:23.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103842024-11-15T21:55:23.433ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
103852024-11-15T21:55:23.433ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103862024-11-15T21:55:23.435ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
103872024-11-15T21:55:23.435ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
103882024-11-15T21:55:23.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103892024-11-15T21:55:23.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103902024-11-15T21:55:23.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 428.32655ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
103912024-11-15T21:55:23.457ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
103922024-11-15T21:55:23.457ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 429.572539ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
103932024-11-15T21:55:23.465ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
103942024-11-15T21:55:23.487ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
103952024-11-15T21:55:23.487ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 459.395652ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
103962024-11-15T21:55:23.487ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 460.143707ms iteration = 31 status = {"physical_disks_added":0}
103972024-11-15T21:55:23.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eda3894c-fd3e-4e0a-a6e6-32c020b755b8", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} })
103982024-11-15T21:55:23.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103992024-11-15T21:55:23.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104002024-11-15T21:55:23.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104012024-11-15T21:55:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104022024-11-15T21:55:23.599ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
104032024-11-15T21:55:23.599ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4905c210-1f21-4cc5-99b0-b724f2b86c25", "content-length": "691", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} })
104042024-11-15T21:55:23.599ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
104052024-11-15T21:55:23.599ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
104062024-11-15T21:55:23.599ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
104072024-11-15T21:55:23.600ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 572.953348ms iteration = 28 status = {}
104082024-11-15T21:55:23.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104092024-11-15T21:55:23.601ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 573.444081ms iteration = 27 status = 0
104102024-11-15T21:55:23.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104112024-11-15T21:55:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104122024-11-15T21:55:23.602ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
104132024-11-15T21:55:23.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104142024-11-15T21:55:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104152024-11-15T21:55:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104162024-11-15T21:55:23.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104172024-11-15T21:55:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104182024-11-15T21:55:23.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104192024-11-15T21:55:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104202024-11-15T21:55:23.606ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
104212024-11-15T21:55:23.606ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
104222024-11-15T21:55:23.606ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
104232024-11-15T21:55:23.606ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 578.882966ms iteration = 15 status = {"generation":2}
104242024-11-15T21:55:23.608ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
104252024-11-15T21:55:23.608ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104262024-11-15T21:55:23.608ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e6527888-0b9e-4010-b80d-771919276be8", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} })
104272024-11-15T21:55:23.609ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
104282024-11-15T21:55:23.609ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b1812bd6-b392-411f-ad03-7664a345823d", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104292024-11-15T21:55:23.609ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104302024-11-15T21:55:23.610ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 582.699702ms iteration = 29 status = {}
104312024-11-15T21:55:23.611ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "55eb1efd-526b-473e-851b-8458ca79487f", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104322024-11-15T21:55:23.611ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104332024-11-15T21:55:23.612ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
104342024-11-15T21:55:23.612ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5313f4df-b925-434b-8eed-688ad65acc68", "content-length": "134", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} })
104352024-11-15T21:55:23.612ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
104362024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
104372024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
104382024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
104392024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104402024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104412024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104422024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104432024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104442024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104452024-11-15T21:55:23.613ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d3140912-8a75-4d7f-872e-25ecfeac54f4", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104462024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104472024-11-15T21:55:23.613ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
104482024-11-15T21:55:23.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104492024-11-15T21:55:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104502024-11-15T21:55:23.615ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104512024-11-15T21:55:23.615ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 587.779294ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
104522024-11-15T21:55:23.615ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
104532024-11-15T21:55:23.616ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bea14921-c043-426a-ad1a-d8b3f679b0bf", "content-length": "2", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} })
104542024-11-15T21:55:23.616ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
104552024-11-15T21:55:23.616ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0ed2a4b-ea09-41ed-9e05-f439391927d9", "content-length": "52", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} })
104562024-11-15T21:55:23.616ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
104572024-11-15T21:55:23.616ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
104582024-11-15T21:55:23.715ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3811b6d8-4472-4d5b-b058-dcb7e414eb2a", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} })
104592024-11-15T21:55:23.715ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
104602024-11-15T21:55:23.715ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
104612024-11-15T21:55:23.715ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "78586614-4cd0-40d4-a5f0-5a7c371904a1", "content-length": "682", "date": "Fri, 15 Nov 2024 21:55:23 GMT"} })
104622024-11-15T21:55:23.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104632024-11-15T21:55:23.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104642024-11-15T21:55:23.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104652024-11-15T21:55:23.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104662024-11-15T21:55:23.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104672024-11-15T21:55:23.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104682024-11-15T21:55:23.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104692024-11-15T21:55:23.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104702024-11-15T21:55:23.731ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 704.022649ms iteration = 27 status = {}
104712024-11-15T21:55:24.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 18fbd899-50e6-4501-8d1a-752d77222801 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104722024-11-15T21:55:24.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 18fbd899-50e6-4501-8d1a-752d77222801 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104732024-11-15T21:55:24.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 18fbd899-50e6-4501-8d1a-752d77222801 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104742024-11-15T21:55:24.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = ef333dd9-4417-4910-8a6a-64db4da7b5cc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
104752024-11-15T21:55:24.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = ef333dd9-4417-4910-8a6a-64db4da7b5cc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
104762024-11-15T21:55:24.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = ef333dd9-4417-4910-8a6a-64db4da7b5cc response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
104772024-11-15T21:55:24.885ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:54479
104782024-11-15T21:55:24.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54479 req_id = e5b9b5f1-1a1f-4cad-a90b-40b2515a25a4 roles = RoleSet { roles: {} } uri = /metrics/producers
104792024-11-15T21:55:24.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54479 req_id = e5b9b5f1-1a1f-4cad-a90b-40b2515a25a4 resource = Database result = Ok(()) uri = /metrics/producers
104802024-11-15T21:55:24.921ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 17a6b664-61ae-47e8-9c94-fdc7e3f8e300
104812024-11-15T21:55:24.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36129 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54479 req_id = e5b9b5f1-1a1f-4cad-a90b-40b2515a25a4 response_code = 201 uri = /metrics/producers
104822024-11-15T21:55:25.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d380cc64-af79-44ed-b4a2-4b4a8eb3ae8b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104832024-11-15T21:55:25.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d380cc64-af79-44ed-b4a2-4b4a8eb3ae8b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104842024-11-15T21:55:25.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d380cc64-af79-44ed-b4a2-4b4a8eb3ae8b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104852024-11-15T21:55:25.113ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36834
104862024-11-15T21:55:25.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36834 req_id = efdb2ab7-460f-405f-8f5b-4129aa8c9a09 roles = RoleSet { roles: {} } uri = /metrics/producers
104872024-11-15T21:55:25.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36834 req_id = efdb2ab7-460f-405f-8f5b-4129aa8c9a09 resource = Database result = Ok(()) uri = /metrics/producers
104882024-11-15T21:55:25.145ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 1ee9a34a-c3be-49f8-8ccd-8456768402b0
104892024-11-15T21:55:25.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32159 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36834 req_id = efdb2ab7-460f-405f-8f5b-4129aa8c9a09 response_code = 201 uri = /metrics/producers
104902024-11-15T21:55:26.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9548ae8-ce07-49ce-8fc8-9d1fd9d0f835 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104912024-11-15T21:55:26.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9548ae8-ce07-49ce-8fc8-9d1fd9d0f835 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104922024-11-15T21:55:26.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9548ae8-ce07-49ce-8fc8-9d1fd9d0f835 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104932024-11-15T21:55:27.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 76c5131f-e6d3-4b44-93d2-e158d7950b99 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104942024-11-15T21:55:27.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 76c5131f-e6d3-4b44-93d2-e158d7950b99 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104952024-11-15T21:55:27.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 76c5131f-e6d3-4b44-93d2-e158d7950b99 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104962024-11-15T21:55:28.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba6b2357-2880-4a9d-a24e-82626d199c72 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104972024-11-15T21:55:28.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba6b2357-2880-4a9d-a24e-82626d199c72 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104982024-11-15T21:55:28.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ba6b2357-2880-4a9d-a24e-82626d199c72 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
104992024-11-15T21:55:29.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = af8f1b27-ea44-4068-8c72-784f7ef9fbb9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105002024-11-15T21:55:29.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = af8f1b27-ea44-4068-8c72-784f7ef9fbb9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105012024-11-15T21:55:29.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = af8f1b27-ea44-4068-8c72-784f7ef9fbb9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105022024-11-15T21:55:30.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 839e6f78-33b3-438d-b1b2-4fc84e9845d7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105032024-11-15T21:55:30.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 839e6f78-33b3-438d-b1b2-4fc84e9845d7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105042024-11-15T21:55:30.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 839e6f78-33b3-438d-b1b2-4fc84e9845d7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105052024-11-15T21:55:30.668ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1496 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = f9a5e177-0abe-4f72-a155-8dc73686eb40 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
105062024-11-15T21:55:31.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bf8b9939-6a43-4484-9207-5e25bbf67ceb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105072024-11-15T21:55:31.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bf8b9939-6a43-4484-9207-5e25bbf67ceb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105082024-11-15T21:55:31.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bf8b9939-6a43-4484-9207-5e25bbf67ceb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105092024-11-15T21:55:32.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cdfddcb4-caae-45f4-826b-83892d9b68ba roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105102024-11-15T21:55:32.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cdfddcb4-caae-45f4-826b-83892d9b68ba resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105112024-11-15T21:55:32.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cdfddcb4-caae-45f4-826b-83892d9b68ba response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105122024-11-15T21:55:33.025ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
105132024-11-15T21:55:33.025ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
105142024-11-15T21:55:33.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105152024-11-15T21:55:33.025ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105162024-11-15T21:55:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105172024-11-15T21:55:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105182024-11-15T21:55:33.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105192024-11-15T21:55:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105202024-11-15T21:55:33.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105212024-11-15T21:55:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105222024-11-15T21:55:33.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105232024-11-15T21:55:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105242024-11-15T21:55:33.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105252024-11-15T21:55:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
105262024-11-15T21:55:33.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105272024-11-15T21:55:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105282024-11-15T21:55:33.048ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
105292024-11-15T21:55:33.048ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.391532ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
105302024-11-15T21:55:33.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105312024-11-15T21:55:33.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105322024-11-15T21:55:33.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.651317ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105332024-11-15T21:55:33.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 181e58bb-02c0-45bb-b29a-6dac4b0046fe roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105342024-11-15T21:55:33.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 181e58bb-02c0-45bb-b29a-6dac4b0046fe resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105352024-11-15T21:55:33.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 181e58bb-02c0-45bb-b29a-6dac4b0046fe response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105362024-11-15T21:55:34.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2560ffcb-20af-4596-a66e-a35e937f8fe0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105372024-11-15T21:55:34.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2560ffcb-20af-4596-a66e-a35e937f8fe0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105382024-11-15T21:55:34.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2560ffcb-20af-4596-a66e-a35e937f8fe0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105392024-11-15T21:55:35.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4d85b462-544f-42b8-b64d-e3e54180506a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105402024-11-15T21:55:35.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4d85b462-544f-42b8-b64d-e3e54180506a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105412024-11-15T21:55:35.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4d85b462-544f-42b8-b64d-e3e54180506a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105422024-11-15T21:55:36.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dd872b30-102c-454f-b2cb-9bf0801c0e9b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105432024-11-15T21:55:36.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dd872b30-102c-454f-b2cb-9bf0801c0e9b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105442024-11-15T21:55:36.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = dd872b30-102c-454f-b2cb-9bf0801c0e9b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105452024-11-15T21:55:37.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ccde3ffc-ade1-4f97-93e3-e24eb564ccf6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105462024-11-15T21:55:37.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ccde3ffc-ade1-4f97-93e3-e24eb564ccf6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105472024-11-15T21:55:37.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ccde3ffc-ade1-4f97-93e3-e24eb564ccf6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105482024-11-15T21:55:38.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5c4479ed-858b-45e1-bf6a-43138fe4dd00 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105492024-11-15T21:55:38.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5c4479ed-858b-45e1-bf6a-43138fe4dd00 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105502024-11-15T21:55:38.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5c4479ed-858b-45e1-bf6a-43138fe4dd00 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105512024-11-15T21:55:39.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c7aa5b27-5512-4f65-9da5-1a8faa59b31c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105522024-11-15T21:55:39.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c7aa5b27-5512-4f65-9da5-1a8faa59b31c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105532024-11-15T21:55:39.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c7aa5b27-5512-4f65-9da5-1a8faa59b31c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105542024-11-15T21:55:40.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 586be21f-e0af-49a9-a5b7-c0d6584d1021 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105552024-11-15T21:55:40.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 586be21f-e0af-49a9-a5b7-c0d6584d1021 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105562024-11-15T21:55:40.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 586be21f-e0af-49a9-a5b7-c0d6584d1021 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105572024-11-15T21:55:41.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bd63120f-a366-400b-ac30-1558a1533e91 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105582024-11-15T21:55:41.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bd63120f-a366-400b-ac30-1558a1533e91 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105592024-11-15T21:55:41.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bd63120f-a366-400b-ac30-1558a1533e91 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105602024-11-15T21:55:42.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 914a981d-5f9e-4e9d-9fbf-f5fed0db0629 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105612024-11-15T21:55:42.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 914a981d-5f9e-4e9d-9fbf-f5fed0db0629 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105622024-11-15T21:55:42.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 914a981d-5f9e-4e9d-9fbf-f5fed0db0629 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105632024-11-15T21:55:43.021ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
105642024-11-15T21:55:43.021ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105652024-11-15T21:55:43.021ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
105662024-11-15T21:55:43.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105672024-11-15T21:55:43.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105682024-11-15T21:55:43.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105692024-11-15T21:55:43.023ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105702024-11-15T21:55:43.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105712024-11-15T21:55:43.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105722024-11-15T21:55:43.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.986656ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105732024-11-15T21:55:43.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105742024-11-15T21:55:43.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105752024-11-15T21:55:43.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105762024-11-15T21:55:43.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105772024-11-15T21:55:43.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105782024-11-15T21:55:43.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105792024-11-15T21:55:43.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
105802024-11-15T21:55:43.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105812024-11-15T21:55:43.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105822024-11-15T21:55:43.043ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
105832024-11-15T21:55:43.043ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.254314ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
105842024-11-15T21:55:43.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 29d1d884-ac70-4e8f-a8b5-a4d1df6b2e23 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105852024-11-15T21:55:43.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 29d1d884-ac70-4e8f-a8b5-a4d1df6b2e23 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105862024-11-15T21:55:43.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 29d1d884-ac70-4e8f-a8b5-a4d1df6b2e23 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105872024-11-15T21:55:44.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 05ab38f1-3353-4b7a-8c43-19acac26c9ca roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105882024-11-15T21:55:44.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 05ab38f1-3353-4b7a-8c43-19acac26c9ca resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105892024-11-15T21:55:44.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 05ab38f1-3353-4b7a-8c43-19acac26c9ca response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105902024-11-15T21:55:45.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 65365fe4-0b79-4ace-a10f-1a4150d5d28f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105912024-11-15T21:55:45.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 65365fe4-0b79-4ace-a10f-1a4150d5d28f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105922024-11-15T21:55:45.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 65365fe4-0b79-4ace-a10f-1a4150d5d28f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
105932024-11-15T21:55:45.575ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58075
105942024-11-15T21:55:45.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58075 req_id = 49dec098-9bd4-4e84-a1a3-d19648ce668a roles = RoleSet { roles: {} } uri = /metrics/producers
105952024-11-15T21:55:45.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58075 req_id = 49dec098-9bd4-4e84-a1a3-d19648ce668a resource = Database result = Ok(()) uri = /metrics/producers
105962024-11-15T21:55:45.623ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 97598fa2-4ef4-4fda-9111-75c99f8284f6
105972024-11-15T21:55:45.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47203 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58075 req_id = 49dec098-9bd4-4e84-a1a3-d19648ce668a response_code = 201 uri = /metrics/producers
105982024-11-15T21:55:45.661ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1424 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = d53d42d4-9376-49da-9b92-725ea1e42be1 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
105992024-11-15T21:55:46.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 510aae23-6d03-4c01-b545-15059c280dde roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106002024-11-15T21:55:46.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 510aae23-6d03-4c01-b545-15059c280dde resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106012024-11-15T21:55:46.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 510aae23-6d03-4c01-b545-15059c280dde response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106022024-11-15T21:55:47.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 70f8fa6c-cefc-4a71-be53-cbc35675b15b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106032024-11-15T21:55:47.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 70f8fa6c-cefc-4a71-be53-cbc35675b15b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106042024-11-15T21:55:47.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 70f8fa6c-cefc-4a71-be53-cbc35675b15b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106052024-11-15T21:55:48.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e0b45ed6-5187-402f-8a32-e2edb69cf2e9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106062024-11-15T21:55:48.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e0b45ed6-5187-402f-8a32-e2edb69cf2e9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106072024-11-15T21:55:48.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e0b45ed6-5187-402f-8a32-e2edb69cf2e9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106082024-11-15T21:55:49.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eb296a85-f9d2-4f06-9340-1c4beb45854b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106092024-11-15T21:55:49.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eb296a85-f9d2-4f06-9340-1c4beb45854b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106102024-11-15T21:55:49.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eb296a85-f9d2-4f06-9340-1c4beb45854b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106112024-11-15T21:55:50.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 144bd4f0-6c45-43be-aaf1-dfe0769985e7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106122024-11-15T21:55:50.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 144bd4f0-6c45-43be-aaf1-dfe0769985e7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106132024-11-15T21:55:50.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 144bd4f0-6c45-43be-aaf1-dfe0769985e7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106142024-11-15T21:55:51.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6621d8a7-f07c-4edb-a2a4-ee6dc15a0b8d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106152024-11-15T21:55:51.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6621d8a7-f07c-4edb-a2a4-ee6dc15a0b8d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106162024-11-15T21:55:51.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6621d8a7-f07c-4edb-a2a4-ee6dc15a0b8d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106172024-11-15T21:55:52.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 682c63c0-e4ef-44ce-a23a-bcc2a280fc5a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106182024-11-15T21:55:52.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 682c63c0-e4ef-44ce-a23a-bcc2a280fc5a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106192024-11-15T21:55:52.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 682c63c0-e4ef-44ce-a23a-bcc2a280fc5a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
106202024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
106212024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
106222024-11-15T21:55:53.012ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
106232024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106242024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
106252024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106262024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
106272024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106282024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106292024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
106302024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
106312024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106322024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
106332024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
106342024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
106352024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106362024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
106372024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106382024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
106392024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106402024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
106412024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
106422024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106432024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
106442024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106452024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
106462024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
106472024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106482024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106492024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
106502024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
106512024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
106522024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106532024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
106542024-11-15T21:55:53.012ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
106552024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106562024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106572024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106582024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106592024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106602024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106612024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
106622024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106632024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106642024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106652024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106662024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106672024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106682024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
106692024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
106702024-11-15T21:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106712024-11-15T21:55:53.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1834, tv_nsec: 975765674 } })
106722024-11-15T21:55:53.015ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.907199ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
106732024-11-15T21:55:53.015ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
106742024-11-15T21:55:53.016ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106752024-11-15T21:55:53.017ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106762024-11-15T21:55:53.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106772024-11-15T21:55:53.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106782024-11-15T21:55:53.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106792024-11-15T21:55:53.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106802024-11-15T21:55:53.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106812024-11-15T21:55:53.024ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1834, tv_nsec: 985308156 } })
106822024-11-15T21:55:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106832024-11-15T21:55:53.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106842024-11-15T21:55:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106852024-11-15T21:55:53.025ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
106862024-11-15T21:55:53.027ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106872024-11-15T21:55:53.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106882024-11-15T21:55:53.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106892024-11-15T21:55:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106902024-11-15T21:55:53.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106912024-11-15T21:55:53.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106922024-11-15T21:55:53.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106932024-11-15T21:55:53.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106942024-11-15T21:55:53.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106952024-11-15T21:55:53.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106962024-11-15T21:55:53.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106972024-11-15T21:55:53.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106982024-11-15T21:55:53.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106992024-11-15T21:55:53.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107002024-11-15T21:55:53.060ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107012024-11-15T21:55:53.060ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
107022024-11-15T21:55:53.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107032024-11-15T21:55:53.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107042024-11-15T21:55:53.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107052024-11-15T21:55:53.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107062024-11-15T21:55:53.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107072024-11-15T21:55:53.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.521592ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107082024-11-15T21:55:53.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107092024-11-15T21:55:53.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107102024-11-15T21:55:53.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107112024-11-15T21:55:53.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107122024-11-15T21:55:53.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107132024-11-15T21:55:53.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107142024-11-15T21:55:53.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.891134ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
107152024-11-15T21:55:53.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107162024-11-15T21:55:53.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107172024-11-15T21:55:53.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
107182024-11-15T21:55:53.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107192024-11-15T21:55:53.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107202024-11-15T21:55:53.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107212024-11-15T21:55:53.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107222024-11-15T21:55:53.071ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
107232024-11-15T21:55:53.071ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107242024-11-15T21:55:53.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107252024-11-15T21:55:53.072ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4d88432-ed73-4707-a1bc-452f39d9030a", "content-length": "26", "date": "Fri, 15 Nov 2024 21:55:52 GMT"} })
107262024-11-15T21:55:53.072ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107272024-11-15T21:55:53.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107282024-11-15T21:55:53.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107292024-11-15T21:55:53.074ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107302024-11-15T21:55:53.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107312024-11-15T21:55:53.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.592713ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
107322024-11-15T21:55:53.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 63.781944ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
107332024-11-15T21:55:53.077ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.911921ms iteration = 28 status = 0
107342024-11-15T21:55:53.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107352024-11-15T21:55:53.078ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107362024-11-15T21:55:53.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107372024-11-15T21:55:53.078ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
107382024-11-15T21:55:53.078ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.18825ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
107392024-11-15T21:55:53.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
107402024-11-15T21:55:53.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107412024-11-15T21:55:53.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107422024-11-15T21:55:53.081ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107432024-11-15T21:55:53.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107442024-11-15T21:55:53.081ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107452024-11-15T21:55:53.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107462024-11-15T21:55:53.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107472024-11-15T21:55:53.083ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1835, tv_nsec: 43884136 } })
107482024-11-15T21:55:53.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107492024-11-15T21:55:53.083ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
107502024-11-15T21:55:53.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107512024-11-15T21:55:53.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
107522024-11-15T21:55:53.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107532024-11-15T21:55:53.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107542024-11-15T21:55:53.110ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
107552024-11-15T21:55:53.110ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107562024-11-15T21:55:53.110ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107572024-11-15T21:55:53.110ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107582024-11-15T21:55:53.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107592024-11-15T21:55:53.110ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac119cf6-b29f-415c-a30c-294e63596ae9", "content-length": "26", "date": "Fri, 15 Nov 2024 21:55:52 GMT"} })
107602024-11-15T21:55:53.110ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107612024-11-15T21:55:53.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107622024-11-15T21:55:53.112ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107632024-11-15T21:55:53.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.691534ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
107642024-11-15T21:55:53.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107652024-11-15T21:55:53.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107662024-11-15T21:55:53.206ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
107672024-11-15T21:55:53.206ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107682024-11-15T21:55:53.206ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae9934e1-0c72-4d7f-b66c-d467028547ca", "content-length": "26", "date": "Fri, 15 Nov 2024 21:55:52 GMT"} })
107692024-11-15T21:55:53.206ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107702024-11-15T21:55:53.209ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
107712024-11-15T21:55:53.234ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 221.706319ms iteration = 28 status = {}
107722024-11-15T21:55:53.288ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
107732024-11-15T21:55:53.288ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8acb37ed-91b9-4d4e-9856-ef36c538368e", "content-length": "2", "date": "Fri, 15 Nov 2024 21:55:53 GMT"} })
107742024-11-15T21:55:53.290ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107752024-11-15T21:55:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107762024-11-15T21:55:53.297ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
107772024-11-15T21:55:53.297ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107782024-11-15T21:55:53.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 286.050807ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107792024-11-15T21:55:53.301ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 289.342788ms iteration = 28 status = null
107802024-11-15T21:55:53.302ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b4b6929-2cec-4367-a8ef-243a6534c87f", "content-length": "372", "date": "Fri, 15 Nov 2024 21:55:52 GMT"} })
107812024-11-15T21:55:53.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107822024-11-15T21:55:53.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107832024-11-15T21:55:53.310ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
107842024-11-15T21:55:53.310ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 298.292496ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
107852024-11-15T21:55:53.328ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107862024-11-15T21:55:53.328ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107872024-11-15T21:55:53.328ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 316.170243ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107882024-11-15T21:55:53.343ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
107892024-11-15T21:55:53.343ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
107902024-11-15T21:55:53.343ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c9bdaf9-35fe-4e0c-9334-9cfe3f6cfb79", "date": "Fri, 15 Nov 2024 21:55:53 GMT"} })
107912024-11-15T21:55:53.343ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107922024-11-15T21:55:53.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107932024-11-15T21:55:53.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107942024-11-15T21:55:53.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107952024-11-15T21:55:53.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107962024-11-15T21:55:53.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107972024-11-15T21:55:53.352ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107982024-11-15T21:55:53.352ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107992024-11-15T21:55:53.352ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f19783a9-6a3d-49d6-959a-53ae5cbcf3fa", "date": "Fri, 15 Nov 2024 21:55:53 GMT"} })
108002024-11-15T21:55:53.354ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 341.773228ms iteration = 30 status = {}
108012024-11-15T21:55:53.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108022024-11-15T21:55:53.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108032024-11-15T21:55:53.359ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
108042024-11-15T21:55:53.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108052024-11-15T21:55:53.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108062024-11-15T21:55:53.368ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
108072024-11-15T21:55:53.368ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "609cb445-d9a1-4a6f-b9d7-83828c8ccd83", "content-length": "134", "date": "Fri, 15 Nov 2024 21:55:53 GMT"} })
108082024-11-15T21:55:53.368ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
108092024-11-15T21:55:53.368ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
108102024-11-15T21:55:53.368ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
108112024-11-15T21:55:53.368ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
108122024-11-15T21:55:53.368ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108132024-11-15T21:55:53.368ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108142024-11-15T21:55:53.368ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108152024-11-15T21:55:53.368ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108162024-11-15T21:55:53.369ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108172024-11-15T21:55:53.369ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108182024-11-15T21:55:53.369ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
108192024-11-15T21:55:53.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108202024-11-15T21:55:53.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108212024-11-15T21:55:53.370ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
108222024-11-15T21:55:53.371ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fb19d19-7856-440e-ab70-05ee0d332ce3", "content-length": "2", "date": "Fri, 15 Nov 2024 21:55:53 GMT"} })
108232024-11-15T21:55:53.371ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
108242024-11-15T21:55:53.371ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bf0ab3b-4614-4d21-972a-ec3e75b30e68", "content-length": "52", "date": "Fri, 15 Nov 2024 21:55:53 GMT"} })
108252024-11-15T21:55:53.371ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
108262024-11-15T21:55:53.371ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
108272024-11-15T21:55:53.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108282024-11-15T21:55:53.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108292024-11-15T21:55:53.390ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 378.299035ms iteration = 32 status = {"physical_disks_added":0}
108302024-11-15T21:55:53.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108312024-11-15T21:55:53.420ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108322024-11-15T21:55:53.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108332024-11-15T21:55:53.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108342024-11-15T21:55:53.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108352024-11-15T21:55:53.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108362024-11-15T21:55:53.452ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108372024-11-15T21:55:53.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108382024-11-15T21:55:53.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "317df21b-dddf-4685-b6c4-cb867b7c79dd", "date": "Fri, 15 Nov 2024 21:55:53 GMT"} })
108392024-11-15T21:55:53.484ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
108402024-11-15T21:55:53.484ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
108412024-11-15T21:55:53.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e8a2379-a2e4-4d68-a0f3-dffc97cdbe2c", "content-length": "682", "date": "Fri, 15 Nov 2024 21:55:53 GMT"} })
108422024-11-15T21:55:53.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108432024-11-15T21:55:53.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108442024-11-15T21:55:53.485ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
108452024-11-15T21:55:53.485ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f57fc543-6b16-46fa-aad2-ce2d8ee0431f", "content-length": "691", "date": "Fri, 15 Nov 2024 21:55:52 GMT"} })
108462024-11-15T21:55:53.485ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
108472024-11-15T21:55:53.485ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
108482024-11-15T21:55:53.485ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
108492024-11-15T21:55:53.487ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 475.206615ms iteration = 29 status = {}
108502024-11-15T21:55:53.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108512024-11-15T21:55:53.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108522024-11-15T21:55:53.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108532024-11-15T21:55:53.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108542024-11-15T21:55:53.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108552024-11-15T21:55:53.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108562024-11-15T21:55:53.503ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 490.545764ms iteration = 28 status = {}
108572024-11-15T21:55:53.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bd099b49-6f75-411e-ad0c-9a7e0f30a3bd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108582024-11-15T21:55:53.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bd099b49-6f75-411e-ad0c-9a7e0f30a3bd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108592024-11-15T21:55:53.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bd099b49-6f75-411e-ad0c-9a7e0f30a3bd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108602024-11-15T21:55:54.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 41110b81-75fc-4030-ae62-0d740560497d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
108612024-11-15T21:55:54.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 41110b81-75fc-4030-ae62-0d740560497d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
108622024-11-15T21:55:54.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 41110b81-75fc-4030-ae62-0d740560497d response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
108632024-11-15T21:55:54.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f09afb8d-8cd6-4f71-baef-9968688192c8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108642024-11-15T21:55:54.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f09afb8d-8cd6-4f71-baef-9968688192c8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108652024-11-15T21:55:54.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f09afb8d-8cd6-4f71-baef-9968688192c8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108662024-11-15T21:55:55.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 33072563-9c88-44d1-bd6a-9dd2280fd4ff roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108672024-11-15T21:55:55.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 33072563-9c88-44d1-bd6a-9dd2280fd4ff resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108682024-11-15T21:55:55.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 33072563-9c88-44d1-bd6a-9dd2280fd4ff response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108692024-11-15T21:55:56.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 89ce5a19-2fff-4d16-9cf4-c114ba6a39e1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108702024-11-15T21:55:56.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 89ce5a19-2fff-4d16-9cf4-c114ba6a39e1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108712024-11-15T21:55:56.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 89ce5a19-2fff-4d16-9cf4-c114ba6a39e1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108722024-11-15T21:55:57.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = aa235b00-89a4-49b6-b26a-1846eecf101d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108732024-11-15T21:55:57.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = aa235b00-89a4-49b6-b26a-1846eecf101d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108742024-11-15T21:55:57.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = aa235b00-89a4-49b6-b26a-1846eecf101d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108752024-11-15T21:55:58.769ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:39020
108762024-11-15T21:55:58.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39020 req_id = 9a7d9b08-b861-4e69-8fd2-e7abef7e4883 roles = RoleSet { roles: {} } uri = /metrics/producers
108772024-11-15T21:55:58.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39020 req_id = 9a7d9b08-b861-4e69-8fd2-e7abef7e4883 resource = Database result = Ok(()) uri = /metrics/producers
108782024-11-15T21:55:58.808ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 54270a8d-942f-4159-a4b4-d6745626c749
108792024-11-15T21:55:58.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39029 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39020 req_id = 9a7d9b08-b861-4e69-8fd2-e7abef7e4883 response_code = 201 uri = /metrics/producers
108802024-11-15T21:55:58.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d3feddd4-8bde-4010-bf74-d6aebb240f7a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108812024-11-15T21:55:58.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d3feddd4-8bde-4010-bf74-d6aebb240f7a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108822024-11-15T21:55:58.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d3feddd4-8bde-4010-bf74-d6aebb240f7a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108832024-11-15T21:55:59.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7e82fdee-58d6-4ea1-9f16-bfdace486882 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108842024-11-15T21:55:59.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7e82fdee-58d6-4ea1-9f16-bfdace486882 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108852024-11-15T21:55:59.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7e82fdee-58d6-4ea1-9f16-bfdace486882 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108862024-11-15T21:56:00.652ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1436 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 7e1d004f-ba51-4151-8d00-d06643bd208b response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
108872024-11-15T21:56:00.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e7de5ef9-c2b2-4220-be6f-d2acc99e0a1f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108882024-11-15T21:56:00.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e7de5ef9-c2b2-4220-be6f-d2acc99e0a1f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108892024-11-15T21:56:00.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e7de5ef9-c2b2-4220-be6f-d2acc99e0a1f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108902024-11-15T21:56:01.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bc586db2-1ed8-4735-88f3-e9e02e332fae roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108912024-11-15T21:56:01.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bc586db2-1ed8-4735-88f3-e9e02e332fae resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108922024-11-15T21:56:01.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bc586db2-1ed8-4735-88f3-e9e02e332fae response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108932024-11-15T21:56:02.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5c46a80e-753d-447f-8a8a-20e3ba1454c7 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108942024-11-15T21:56:02.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5c46a80e-753d-447f-8a8a-20e3ba1454c7 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108952024-11-15T21:56:02.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5c46a80e-753d-447f-8a8a-20e3ba1454c7 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
108962024-11-15T21:56:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
108972024-11-15T21:56:03.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
108982024-11-15T21:56:03.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108992024-11-15T21:56:03.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109002024-11-15T21:56:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109012024-11-15T21:56:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109022024-11-15T21:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109032024-11-15T21:56:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109042024-11-15T21:56:03.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109052024-11-15T21:56:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109062024-11-15T21:56:03.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109072024-11-15T21:56:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109082024-11-15T21:56:03.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109092024-11-15T21:56:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
109102024-11-15T21:56:03.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109112024-11-15T21:56:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109122024-11-15T21:56:03.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
109132024-11-15T21:56:03.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.470739ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
109142024-11-15T21:56:03.039ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109152024-11-15T21:56:03.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109162024-11-15T21:56:03.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.571747ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109172024-11-15T21:56:03.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2212153a-2837-4d4e-bf45-e74154b4ecec roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109182024-11-15T21:56:03.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2212153a-2837-4d4e-bf45-e74154b4ecec resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109192024-11-15T21:56:03.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2212153a-2837-4d4e-bf45-e74154b4ecec response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109202024-11-15T21:56:04.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a15a18bf-5e80-4f84-8674-265b4a3fa1c6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109212024-11-15T21:56:04.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a15a18bf-5e80-4f84-8674-265b4a3fa1c6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109222024-11-15T21:56:04.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a15a18bf-5e80-4f84-8674-265b4a3fa1c6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109232024-11-15T21:56:05.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2fcfe2a5-8003-4971-a682-7f5bf5c5ad02 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109242024-11-15T21:56:05.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2fcfe2a5-8003-4971-a682-7f5bf5c5ad02 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109252024-11-15T21:56:05.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 2fcfe2a5-8003-4971-a682-7f5bf5c5ad02 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109262024-11-15T21:56:07.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 82e9957f-4e7b-4584-a7f5-ff752b3e0ffb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109272024-11-15T21:56:07.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 82e9957f-4e7b-4584-a7f5-ff752b3e0ffb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109282024-11-15T21:56:07.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 82e9957f-4e7b-4584-a7f5-ff752b3e0ffb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109292024-11-15T21:56:08.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 389386a2-5d38-40e2-b2b4-1b9d66ff1e2a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109302024-11-15T21:56:08.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 389386a2-5d38-40e2-b2b4-1b9d66ff1e2a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109312024-11-15T21:56:08.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 389386a2-5d38-40e2-b2b4-1b9d66ff1e2a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109322024-11-15T21:56:09.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1f0c26c-9ef9-41ba-9453-dfb3ae3a55b5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109332024-11-15T21:56:09.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1f0c26c-9ef9-41ba-9453-dfb3ae3a55b5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109342024-11-15T21:56:09.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d1f0c26c-9ef9-41ba-9453-dfb3ae3a55b5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109352024-11-15T21:56:10.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d19d3a1f-fe9e-4895-b677-21b96c711cd1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109362024-11-15T21:56:10.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d19d3a1f-fe9e-4895-b677-21b96c711cd1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109372024-11-15T21:56:10.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d19d3a1f-fe9e-4895-b677-21b96c711cd1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109382024-11-15T21:56:11.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 44c4f460-5e9b-4543-abf8-9a5ea4d476d9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109392024-11-15T21:56:11.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 44c4f460-5e9b-4543-abf8-9a5ea4d476d9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109402024-11-15T21:56:11.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 44c4f460-5e9b-4543-abf8-9a5ea4d476d9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109412024-11-15T21:56:12.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ce11bbf0-59b5-4482-8550-a574adc83e70 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109422024-11-15T21:56:12.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ce11bbf0-59b5-4482-8550-a574adc83e70 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109432024-11-15T21:56:12.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ce11bbf0-59b5-4482-8550-a574adc83e70 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109442024-11-15T21:56:13.006ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
109452024-11-15T21:56:13.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109462024-11-15T21:56:13.006ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
109472024-11-15T21:56:13.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109482024-11-15T21:56:13.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109492024-11-15T21:56:13.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109502024-11-15T21:56:13.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109512024-11-15T21:56:13.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109522024-11-15T21:56:13.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109532024-11-15T21:56:13.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109542024-11-15T21:56:13.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109552024-11-15T21:56:13.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109562024-11-15T21:56:13.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109572024-11-15T21:56:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109582024-11-15T21:56:13.036ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.498298ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109592024-11-15T21:56:13.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109602024-11-15T21:56:13.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
109612024-11-15T21:56:13.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109622024-11-15T21:56:13.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109632024-11-15T21:56:13.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
109642024-11-15T21:56:13.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.243887ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
109652024-11-15T21:56:13.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8b6e51c0-cdd0-4c17-be27-c747eafab43f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109662024-11-15T21:56:13.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8b6e51c0-cdd0-4c17-be27-c747eafab43f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109672024-11-15T21:56:13.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8b6e51c0-cdd0-4c17-be27-c747eafab43f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109682024-11-15T21:56:14.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fa0e9820-7d35-413d-9ba8-f8cca3efe0a4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109692024-11-15T21:56:14.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fa0e9820-7d35-413d-9ba8-f8cca3efe0a4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109702024-11-15T21:56:14.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fa0e9820-7d35-413d-9ba8-f8cca3efe0a4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109712024-11-15T21:56:15.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eaabc38f-59f7-43bf-830e-2cf4f60df2dc roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109722024-11-15T21:56:15.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eaabc38f-59f7-43bf-830e-2cf4f60df2dc resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109732024-11-15T21:56:15.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = eaabc38f-59f7-43bf-830e-2cf4f60df2dc response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109742024-11-15T21:56:15.648ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 0fbbb7fc-8714-44ba-b808-c5b294f9cf2b response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
109752024-11-15T21:56:16.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 38bcfa31-b5cc-47f2-81fe-46cadcb05695 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109762024-11-15T21:56:16.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 38bcfa31-b5cc-47f2-81fe-46cadcb05695 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109772024-11-15T21:56:16.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 38bcfa31-b5cc-47f2-81fe-46cadcb05695 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109782024-11-15T21:56:17.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5f6398b2-5cca-4643-8399-231d7aa47b23 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109792024-11-15T21:56:17.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5f6398b2-5cca-4643-8399-231d7aa47b23 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109802024-11-15T21:56:17.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5f6398b2-5cca-4643-8399-231d7aa47b23 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109812024-11-15T21:56:18.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e3193495-d950-45e0-b337-0f4b8c5d2d62 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109822024-11-15T21:56:18.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e3193495-d950-45e0-b337-0f4b8c5d2d62 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109832024-11-15T21:56:18.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e3193495-d950-45e0-b337-0f4b8c5d2d62 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109842024-11-15T21:56:19.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = be65840a-c80b-4564-8be1-48b1c9d3bd6e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109852024-11-15T21:56:19.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = be65840a-c80b-4564-8be1-48b1c9d3bd6e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109862024-11-15T21:56:19.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = be65840a-c80b-4564-8be1-48b1c9d3bd6e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109872024-11-15T21:56:20.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1ddfed9c-a4fd-42c1-8efe-f52cd715da92 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109882024-11-15T21:56:20.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1ddfed9c-a4fd-42c1-8efe-f52cd715da92 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109892024-11-15T21:56:20.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1ddfed9c-a4fd-42c1-8efe-f52cd715da92 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109902024-11-15T21:56:20.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = c6de0e0f-080e-466f-8519-6481c7eee017 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
109912024-11-15T21:56:20.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = c6de0e0f-080e-466f-8519-6481c7eee017 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
109922024-11-15T21:56:20.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = c6de0e0f-080e-466f-8519-6481c7eee017 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
109932024-11-15T21:56:20.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 2b8ea384-67ee-4ed0-bfda-ffe336760105 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
109942024-11-15T21:56:20.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 2b8ea384-67ee-4ed0-bfda-ffe336760105 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
109952024-11-15T21:56:20.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 2b8ea384-67ee-4ed0-bfda-ffe336760105 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
109962024-11-15T21:56:21.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5c82f1bf-b79e-4847-a93a-9c11cb515a25 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109972024-11-15T21:56:21.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5c82f1bf-b79e-4847-a93a-9c11cb515a25 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109982024-11-15T21:56:21.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5c82f1bf-b79e-4847-a93a-9c11cb515a25 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
109992024-11-15T21:56:22.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1c2b10a4-1f47-41e5-8172-6b18575b9bde roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
110002024-11-15T21:56:22.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1c2b10a4-1f47-41e5-8172-6b18575b9bde resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
110012024-11-15T21:56:22.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1c2b10a4-1f47-41e5-8172-6b18575b9bde response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
110022024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
110032024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
110042024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110052024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
110062024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110072024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
110082024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
110092024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
110102024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
110112024-11-15T21:56:23.004ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:46:23.004339939 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
110122024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
110132024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110142024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
110152024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
110162024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
110172024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
110182024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
110192024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
110202024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
110212024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
110222024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110232024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
110242024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
110252024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110262024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
110272024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
110282024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110292024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
110302024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
110312024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
110322024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
110332024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110342024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110352024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
110362024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
110372024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110382024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
110392024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110402024-11-15T21:56:23.004ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
110412024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
110422024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110432024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
110442024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
110452024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
110462024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110472024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
110482024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110492024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
110502024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
110512024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110522024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
110532024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
110542024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110552024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
110562024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
110572024-11-15T21:56:23.004ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
110582024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.86\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
110592024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
110602024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
110612024-11-15T21:56:23.004ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110622024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110632024-11-15T21:56:23.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110642024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110652024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
110662024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
110672024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110682024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
110692024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
110702024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
110712024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110722024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110732024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110742024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110752024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110762024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110772024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110782024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110792024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110802024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110812024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
110822024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110832024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110842024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110852024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110862024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110872024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
110882024-11-15T21:56:23.005ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1864, tv_nsec: 973726938 } })
110892024-11-15T21:56:23.005ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1864, tv_nsec: 973766778 } })
110902024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
110912024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.58335ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
110922024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
110932024-11-15T21:56:23.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.49113ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
110942024-11-15T21:56:23.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110952024-11-15T21:56:23.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110962024-11-15T21:56:23.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110972024-11-15T21:56:23.008ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:46:23.004339939 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
110982024-11-15T21:56:23.008ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.804395ms iteration = 15 status = {"expiration":"2024-11-15T21:46:23.004339939Z","pruned":[]}
110992024-11-15T21:56:23.009ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.023793ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
111002024-11-15T21:56:23.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111012024-11-15T21:56:23.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111022024-11-15T21:56:23.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111032024-11-15T21:56:23.012ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1864, tv_nsec: 980530062 } })
111042024-11-15T21:56:23.012ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
111052024-11-15T21:56:23.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111062024-11-15T21:56:23.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111072024-11-15T21:56:23.014ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1864, tv_nsec: 982796266 } })
111082024-11-15T21:56:23.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111092024-11-15T21:56:23.014ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
111102024-11-15T21:56:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
111112024-11-15T21:56:23.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111122024-11-15T21:56:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111132024-11-15T21:56:23.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111142024-11-15T21:56:23.026ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111152024-11-15T21:56:23.026ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.699321ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
111162024-11-15T21:56:23.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111172024-11-15T21:56:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111182024-11-15T21:56:23.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111192024-11-15T21:56:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111202024-11-15T21:56:23.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111212024-11-15T21:56:23.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111222024-11-15T21:56:23.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111232024-11-15T21:56:23.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111242024-11-15T21:56:23.057ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111252024-11-15T21:56:23.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
111262024-11-15T21:56:23.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111272024-11-15T21:56:23.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111282024-11-15T21:56:23.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111292024-11-15T21:56:23.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111302024-11-15T21:56:23.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111312024-11-15T21:56:23.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.883166ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
111322024-11-15T21:56:23.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111332024-11-15T21:56:23.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111342024-11-15T21:56:23.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.490359ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
111352024-11-15T21:56:23.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111362024-11-15T21:56:23.065ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111372024-11-15T21:56:23.065ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
111382024-11-15T21:56:23.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111392024-11-15T21:56:23.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.294268ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111402024-11-15T21:56:23.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111412024-11-15T21:56:23.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111422024-11-15T21:56:23.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111432024-11-15T21:56:23.066ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111442024-11-15T21:56:23.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111452024-11-15T21:56:23.066ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111462024-11-15T21:56:23.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
111472024-11-15T21:56:23.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111482024-11-15T21:56:23.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111492024-11-15T21:56:23.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111502024-11-15T21:56:23.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111512024-11-15T21:56:23.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
111522024-11-15T21:56:23.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111532024-11-15T21:56:23.070ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
111542024-11-15T21:56:23.070ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
111552024-11-15T21:56:23.070ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.340984ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
111562024-11-15T21:56:23.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
111572024-11-15T21:56:23.070ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
111582024-11-15T21:56:23.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111592024-11-15T21:56:23.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
111602024-11-15T21:56:23.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111612024-11-15T21:56:23.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111622024-11-15T21:56:23.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111632024-11-15T21:56:23.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111642024-11-15T21:56:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111652024-11-15T21:56:23.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111662024-11-15T21:56:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111672024-11-15T21:56:23.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111682024-11-15T21:56:23.076ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111692024-11-15T21:56:23.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111702024-11-15T21:56:23.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111712024-11-15T21:56:23.077ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111722024-11-15T21:56:23.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111732024-11-15T21:56:23.078ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111742024-11-15T21:56:23.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111752024-11-15T21:56:23.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111762024-11-15T21:56:23.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111772024-11-15T21:56:23.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111782024-11-15T21:56:23.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1865, tv_nsec: 54115540 } })
111792024-11-15T21:56:23.086ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
111802024-11-15T21:56:23.092ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
111812024-11-15T21:56:23.092ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
111822024-11-15T21:56:23.092ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
111832024-11-15T21:56:23.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111842024-11-15T21:56:23.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111852024-11-15T21:56:23.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111862024-11-15T21:56:23.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111872024-11-15T21:56:23.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111882024-11-15T21:56:23.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111892024-11-15T21:56:23.102ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
111902024-11-15T21:56:23.102ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.367779ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
111912024-11-15T21:56:23.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111922024-11-15T21:56:23.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111932024-11-15T21:56:23.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111942024-11-15T21:56:23.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111952024-11-15T21:56:23.117ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
111962024-11-15T21:56:23.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111972024-11-15T21:56:23.123ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111982024-11-15T21:56:23.123ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111992024-11-15T21:56:23.123ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112002024-11-15T21:56:23.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112012024-11-15T21:56:23.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.488999ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
112022024-11-15T21:56:23.126ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
112032024-11-15T21:56:23.126ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 122.167693ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
112042024-11-15T21:56:23.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 128.231582ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112052024-11-15T21:56:23.134ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
112062024-11-15T21:56:23.135ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
112072024-11-15T21:56:23.135ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
112082024-11-15T21:56:23.135ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 130.713598ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
112092024-11-15T21:56:23.138ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
112102024-11-15T21:56:23.138ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
112112024-11-15T21:56:23.138ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
112122024-11-15T21:56:23.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112132024-11-15T21:56:23.138ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112142024-11-15T21:56:23.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112152024-11-15T21:56:23.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.292382ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
112162024-11-15T21:56:23.140ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112172024-11-15T21:56:23.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112182024-11-15T21:56:23.140ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112192024-11-15T21:56:23.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112202024-11-15T21:56:23.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
112212024-11-15T21:56:23.143ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112222024-11-15T21:56:23.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112232024-11-15T21:56:23.148ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
112242024-11-15T21:56:23.148ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
112252024-11-15T21:56:23.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112262024-11-15T21:56:23.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112272024-11-15T21:56:23.150ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
112282024-11-15T21:56:23.150ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112292024-11-15T21:56:23.151ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1db92197-b908-4320-97ef-a326c0e7ced8", "content-length": "26", "date": "Fri, 15 Nov 2024 21:56:22 GMT"} })
112302024-11-15T21:56:23.151ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112312024-11-15T21:56:23.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112322024-11-15T21:56:23.154ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112332024-11-15T21:56:23.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112342024-11-15T21:56:23.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112352024-11-15T21:56:23.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112362024-11-15T21:56:23.157ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
112372024-11-15T21:56:23.157ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
112382024-11-15T21:56:23.157ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
112392024-11-15T21:56:23.157ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 152.761312ms iteration = 16 status = {"generation":2}
112402024-11-15T21:56:23.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112412024-11-15T21:56:23.160ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
112422024-11-15T21:56:23.160ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 155.751381ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
112432024-11-15T21:56:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
112442024-11-15T21:56:23.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112452024-11-15T21:56:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112462024-11-15T21:56:23.167ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112472024-11-15T21:56:23.167ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
112482024-11-15T21:56:23.167ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 163.23741ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
112492024-11-15T21:56:23.168ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
112502024-11-15T21:56:23.168ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 164.239676ms iteration = 29 status = 0
112512024-11-15T21:56:23.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112522024-11-15T21:56:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112532024-11-15T21:56:23.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112542024-11-15T21:56:23.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112552024-11-15T21:56:23.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112562024-11-15T21:56:23.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112572024-11-15T21:56:23.195ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112582024-11-15T21:56:23.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112592024-11-15T21:56:23.196ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
112602024-11-15T21:56:23.196ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112612024-11-15T21:56:23.196ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbf4cb32-5cf4-4793-8d29-6cb93c19934e", "content-length": "26", "date": "Fri, 15 Nov 2024 21:56:22 GMT"} })
112622024-11-15T21:56:23.196ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112632024-11-15T21:56:23.197ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112642024-11-15T21:56:23.199ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112652024-11-15T21:56:23.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
112662024-11-15T21:56:23.200ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112672024-11-15T21:56:23.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112682024-11-15T21:56:23.222ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
112692024-11-15T21:56:23.222ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
112702024-11-15T21:56:23.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112712024-11-15T21:56:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112722024-11-15T21:56:23.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112732024-11-15T21:56:23.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112742024-11-15T21:56:23.228ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112752024-11-15T21:56:23.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112762024-11-15T21:56:23.231ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
112772024-11-15T21:56:23.231ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
112782024-11-15T21:56:23.231ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
112792024-11-15T21:56:23.231ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 227.538647ms iteration = 16 status = {"generation":1}
112802024-11-15T21:56:23.247ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
112812024-11-15T21:56:23.247ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 243.513791ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
112822024-11-15T21:56:23.263ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 258.71364ms iteration = 33 status = {"physical_disks_added":0}
112832024-11-15T21:56:23.290ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112842024-11-15T21:56:23.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112852024-11-15T21:56:23.303ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
112862024-11-15T21:56:23.313ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 309.518169ms iteration = 29 status = {}
112872024-11-15T21:56:23.333ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
112882024-11-15T21:56:23.333ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112892024-11-15T21:56:23.333ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "093d7d96-0f33-4ee5-8866-b60944ec1895", "content-length": "372", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} })
112902024-11-15T21:56:23.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112912024-11-15T21:56:23.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112922024-11-15T21:56:23.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112932024-11-15T21:56:23.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112942024-11-15T21:56:23.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112952024-11-15T21:56:23.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112962024-11-15T21:56:23.338ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112972024-11-15T21:56:23.340ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112982024-11-15T21:56:23.340ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112992024-11-15T21:56:23.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113002024-11-15T21:56:23.356ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
113012024-11-15T21:56:23.357ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "50e3828c-faae-45e3-9049-4d75276e34aa", "content-length": "2", "date": "Fri, 15 Nov 2024 21:56:22 GMT"} })
113022024-11-15T21:56:23.358ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113032024-11-15T21:56:23.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113042024-11-15T21:56:23.361ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 356.740245ms iteration = 29 status = null
113052024-11-15T21:56:23.376ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
113062024-11-15T21:56:23.376ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
113072024-11-15T21:56:23.376ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "76b6b85a-6be8-42d4-8d15-046396b25b3b", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} })
113082024-11-15T21:56:23.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113092024-11-15T21:56:23.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113102024-11-15T21:56:23.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113112024-11-15T21:56:23.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113122024-11-15T21:56:23.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113132024-11-15T21:56:23.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113142024-11-15T21:56:23.385ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
113152024-11-15T21:56:23.385ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113162024-11-15T21:56:23.385ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "70b06459-0dda-4e0f-9c6c-03b0db89fa7e", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} })
113172024-11-15T21:56:23.386ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
113182024-11-15T21:56:23.386ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113192024-11-15T21:56:23.387ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c292537c-09e0-45e3-a559-5441f8d2f2d7", "content-length": "26", "date": "Fri, 15 Nov 2024 21:56:22 GMT"} })
113202024-11-15T21:56:23.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113212024-11-15T21:56:23.387ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 383.020666ms iteration = 31 status = {}
113222024-11-15T21:56:23.389ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
113232024-11-15T21:56:23.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8524e62f-7dfd-415c-a9f9-b1dc025a00af roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113242024-11-15T21:56:23.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8524e62f-7dfd-415c-a9f9-b1dc025a00af resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113252024-11-15T21:56:23.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8524e62f-7dfd-415c-a9f9-b1dc025a00af response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113262024-11-15T21:56:23.409ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
113272024-11-15T21:56:23.409ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "40086d3e-5916-4a31-ba4d-9300e59f521f", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113282024-11-15T21:56:23.409ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113292024-11-15T21:56:23.410ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "93d3318e-28c9-41f0-8073-7535b2b2473d", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113302024-11-15T21:56:23.410ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113312024-11-15T21:56:23.412ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113322024-11-15T21:56:23.412ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 407.924628ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
113332024-11-15T21:56:23.419ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
113342024-11-15T21:56:23.419ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cbc085ea-5c4b-459d-8a8c-a1549da9d734", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
113352024-11-15T21:56:23.419ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
113362024-11-15T21:56:23.421ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f295ab50-170c-4a3b-a64d-7dea03794ecc", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
113372024-11-15T21:56:23.421ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
113382024-11-15T21:56:23.423ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "54f280f5-7716-4e4d-aec4-60e1f1d072ad", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
113392024-11-15T21:56:23.423ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
113402024-11-15T21:56:23.425ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
113412024-11-15T21:56:23.425ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 421.015042ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
113422024-11-15T21:56:23.448ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
113432024-11-15T21:56:23.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113442024-11-15T21:56:23.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113452024-11-15T21:56:23.507ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
113462024-11-15T21:56:23.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113472024-11-15T21:56:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113482024-11-15T21:56:23.518ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
113492024-11-15T21:56:23.518ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8fb8729-4aa2-4b52-a81b-ce07ede2e745", "content-length": "134", "date": "Fri, 15 Nov 2024 21:56:22 GMT"} })
113502024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
113512024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
113522024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
113532024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
113542024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113552024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113562024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113572024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113582024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113592024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113602024-11-15T21:56:23.518ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
113612024-11-15T21:56:23.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113622024-11-15T21:56:23.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113632024-11-15T21:56:23.521ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
113642024-11-15T21:56:23.521ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "900753c2-816e-44e5-b139-cc4db1a67ae1", "content-length": "2", "date": "Fri, 15 Nov 2024 21:56:22 GMT"} })
113652024-11-15T21:56:23.521ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
113662024-11-15T21:56:23.521ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4491f04-b1b8-45f9-b46c-a71f5e2e7959", "content-length": "52", "date": "Fri, 15 Nov 2024 21:56:22 GMT"} })
113672024-11-15T21:56:23.521ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
113682024-11-15T21:56:23.521ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
113692024-11-15T21:56:23.533ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc40cabf-f0fb-4290-ad2c-df367aafc2f2", "content-length": "691", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} })
113702024-11-15T21:56:23.533ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
113712024-11-15T21:56:23.533ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
113722024-11-15T21:56:23.533ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
113732024-11-15T21:56:23.534ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 530.160511ms iteration = 30 status = {}
113742024-11-15T21:56:23.630ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c6f6641d-ca27-4f6f-9024-fd2efdf31f9b", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} })
113752024-11-15T21:56:23.630ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
113762024-11-15T21:56:23.630ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
113772024-11-15T21:56:23.634ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e7c198e-2b82-4ca2-8205-d4eab2b76434", "content-length": "682", "date": "Fri, 15 Nov 2024 21:56:23 GMT"} })
113782024-11-15T21:56:23.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113792024-11-15T21:56:23.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113802024-11-15T21:56:23.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113812024-11-15T21:56:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113822024-11-15T21:56:23.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113832024-11-15T21:56:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113842024-11-15T21:56:23.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113852024-11-15T21:56:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113862024-11-15T21:56:23.651ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 647.34761ms iteration = 29 status = {}
113872024-11-15T21:56:24.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ccd487f-c65a-4a5f-8bc2-0595aeaaab56 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113882024-11-15T21:56:24.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ccd487f-c65a-4a5f-8bc2-0595aeaaab56 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113892024-11-15T21:56:24.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 7ccd487f-c65a-4a5f-8bc2-0595aeaaab56 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113902024-11-15T21:56:24.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 026d4088-dca8-4f62-bad8-bc6d99fcb1e2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
113912024-11-15T21:56:24.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 026d4088-dca8-4f62-bad8-bc6d99fcb1e2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
113922024-11-15T21:56:24.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 026d4088-dca8-4f62-bad8-bc6d99fcb1e2 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
113932024-11-15T21:56:25.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b02b985f-dfdc-4e32-aed9-e3610f024017 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113942024-11-15T21:56:25.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b02b985f-dfdc-4e32-aed9-e3610f024017 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113952024-11-15T21:56:25.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b02b985f-dfdc-4e32-aed9-e3610f024017 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113962024-11-15T21:56:26.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9bcd5cc-325c-4d2a-baf5-6751921a4601 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113972024-11-15T21:56:26.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9bcd5cc-325c-4d2a-baf5-6751921a4601 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113982024-11-15T21:56:26.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d9bcd5cc-325c-4d2a-baf5-6751921a4601 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
113992024-11-15T21:56:27.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 402136af-7e1a-4f8f-aaf2-371140631592 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114002024-11-15T21:56:27.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 402136af-7e1a-4f8f-aaf2-371140631592 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114012024-11-15T21:56:27.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 402136af-7e1a-4f8f-aaf2-371140631592 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114022024-11-15T21:56:28.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ce50cf0b-1870-4dae-8e35-e379da919ed1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114032024-11-15T21:56:28.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ce50cf0b-1870-4dae-8e35-e379da919ed1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114042024-11-15T21:56:28.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ce50cf0b-1870-4dae-8e35-e379da919ed1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114052024-11-15T21:56:29.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 398bff4d-0a67-49d9-9189-f807d36a27f1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114062024-11-15T21:56:29.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 398bff4d-0a67-49d9-9189-f807d36a27f1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114072024-11-15T21:56:29.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 398bff4d-0a67-49d9-9189-f807d36a27f1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114082024-11-15T21:56:30.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 176aa81f-7bdf-42b7-92dd-9944833f3297 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114092024-11-15T21:56:30.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 176aa81f-7bdf-42b7-92dd-9944833f3297 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114102024-11-15T21:56:30.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 176aa81f-7bdf-42b7-92dd-9944833f3297 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114112024-11-15T21:56:30.647ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1524 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = c9fe9195-fc1f-4202-b80a-2e227a16d0d9 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
114122024-11-15T21:56:31.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0b8dc10-3fdf-4670-b692-64b5a41272e5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114132024-11-15T21:56:31.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0b8dc10-3fdf-4670-b692-64b5a41272e5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114142024-11-15T21:56:31.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b0b8dc10-3fdf-4670-b692-64b5a41272e5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114152024-11-15T21:56:32.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0fb29aef-cbed-4835-8c52-46a1ad889ca1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114162024-11-15T21:56:32.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0fb29aef-cbed-4835-8c52-46a1ad889ca1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114172024-11-15T21:56:32.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 0fb29aef-cbed-4835-8c52-46a1ad889ca1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114182024-11-15T21:56:33.004ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
114192024-11-15T21:56:33.004ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
114202024-11-15T21:56:33.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114212024-11-15T21:56:33.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114222024-11-15T21:56:33.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114232024-11-15T21:56:33.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114242024-11-15T21:56:33.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114252024-11-15T21:56:33.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114262024-11-15T21:56:33.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114272024-11-15T21:56:33.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.057636ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114282024-11-15T21:56:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114292024-11-15T21:56:33.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114302024-11-15T21:56:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114312024-11-15T21:56:33.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114322024-11-15T21:56:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114332024-11-15T21:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114342024-11-15T21:56:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
114352024-11-15T21:56:33.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114362024-11-15T21:56:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114372024-11-15T21:56:33.023ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
114382024-11-15T21:56:33.023ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.816462ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
114392024-11-15T21:56:33.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e5d01d0c-c282-4e22-b795-2af4ded7f10e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114402024-11-15T21:56:33.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e5d01d0c-c282-4e22-b795-2af4ded7f10e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114412024-11-15T21:56:33.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e5d01d0c-c282-4e22-b795-2af4ded7f10e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114422024-11-15T21:56:34.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = acbb3ba2-a355-4ba1-ad5d-bc62a3b7cd5a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114432024-11-15T21:56:34.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = acbb3ba2-a355-4ba1-ad5d-bc62a3b7cd5a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114442024-11-15T21:56:34.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = acbb3ba2-a355-4ba1-ad5d-bc62a3b7cd5a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114452024-11-15T21:56:35.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 832b63d0-252e-42a0-aa89-732441d31f9a roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
114462024-11-15T21:56:35.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 832b63d0-252e-42a0-aa89-732441d31f9a resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
114472024-11-15T21:56:35.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 832b63d0-252e-42a0-aa89-732441d31f9a response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
114482024-11-15T21:56:35.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = fdf24902-8b7e-4567-83b8-b21d9ed8d4c1 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
114492024-11-15T21:56:35.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = fdf24902-8b7e-4567-83b8-b21d9ed8d4c1 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
114502024-11-15T21:56:35.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = fdf24902-8b7e-4567-83b8-b21d9ed8d4c1 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
114512024-11-15T21:56:35.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e60f8d86-8000-44b2-b54f-43afac871e99 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114522024-11-15T21:56:35.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e60f8d86-8000-44b2-b54f-43afac871e99 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114532024-11-15T21:56:35.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e60f8d86-8000-44b2-b54f-43afac871e99 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114542024-11-15T21:56:36.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8d913120-0ec3-4363-bc95-66a316f7c02f roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114552024-11-15T21:56:36.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8d913120-0ec3-4363-bc95-66a316f7c02f resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114562024-11-15T21:56:36.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8d913120-0ec3-4363-bc95-66a316f7c02f response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114572024-11-15T21:56:37.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = de6b2dde-fb1c-4177-b502-61c82763108e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114582024-11-15T21:56:37.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = de6b2dde-fb1c-4177-b502-61c82763108e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114592024-11-15T21:56:37.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = de6b2dde-fb1c-4177-b502-61c82763108e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114602024-11-15T21:56:38.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = abd7cd2a-c323-4c56-9698-d4cabd66e6c9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114612024-11-15T21:56:38.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = abd7cd2a-c323-4c56-9698-d4cabd66e6c9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114622024-11-15T21:56:38.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = abd7cd2a-c323-4c56-9698-d4cabd66e6c9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114632024-11-15T21:56:39.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 51762a6c-605e-4c75-9524-eb08763ef841 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114642024-11-15T21:56:39.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 51762a6c-605e-4c75-9524-eb08763ef841 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114652024-11-15T21:56:39.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 51762a6c-605e-4c75-9524-eb08763ef841 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114662024-11-15T21:56:40.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 09ea1c57-48ff-4d44-844d-53f7b63bf6b9 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114672024-11-15T21:56:40.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 09ea1c57-48ff-4d44-844d-53f7b63bf6b9 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114682024-11-15T21:56:40.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 09ea1c57-48ff-4d44-844d-53f7b63bf6b9 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114692024-11-15T21:56:41.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4586e847-ec23-4857-9763-6515964fb29b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114702024-11-15T21:56:41.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4586e847-ec23-4857-9763-6515964fb29b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114712024-11-15T21:56:41.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4586e847-ec23-4857-9763-6515964fb29b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114722024-11-15T21:56:42.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3db93443-89a5-4b6d-8ee3-f1d106440a67 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114732024-11-15T21:56:42.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3db93443-89a5-4b6d-8ee3-f1d106440a67 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114742024-11-15T21:56:42.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 3db93443-89a5-4b6d-8ee3-f1d106440a67 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114752024-11-15T21:56:43.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
114762024-11-15T21:56:43.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
114772024-11-15T21:56:43.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114782024-11-15T21:56:43.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114792024-11-15T21:56:43.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114802024-11-15T21:56:43.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114812024-11-15T21:56:43.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114822024-11-15T21:56:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114832024-11-15T21:56:43.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114842024-11-15T21:56:43.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114852024-11-15T21:56:43.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114862024-11-15T21:56:43.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114872024-11-15T21:56:43.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114882024-11-15T21:56:43.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114892024-11-15T21:56:43.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114902024-11-15T21:56:43.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
114912024-11-15T21:56:43.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114922024-11-15T21:56:43.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114932024-11-15T21:56:43.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
114942024-11-15T21:56:43.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.273742ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
114952024-11-15T21:56:43.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.511012ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114962024-11-15T21:56:43.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a2173bfb-3bbb-42fa-a3e4-9e3bd9d81914 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114972024-11-15T21:56:43.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a2173bfb-3bbb-42fa-a3e4-9e3bd9d81914 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114982024-11-15T21:56:43.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a2173bfb-3bbb-42fa-a3e4-9e3bd9d81914 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
114992024-11-15T21:56:44.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6bafcd3e-07c0-45f3-9f54-4b52d13ae5be roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115002024-11-15T21:56:44.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6bafcd3e-07c0-45f3-9f54-4b52d13ae5be resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115012024-11-15T21:56:44.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 6bafcd3e-07c0-45f3-9f54-4b52d13ae5be response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115022024-11-15T21:56:45.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1502 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 571b3a6c-8680-40d1-84d3-2cc8f805c95e response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
115032024-11-15T21:56:45.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1ea7d134-8ae5-483c-ab33-6bbed30e2e1d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115042024-11-15T21:56:45.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1ea7d134-8ae5-483c-ab33-6bbed30e2e1d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115052024-11-15T21:56:45.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1ea7d134-8ae5-483c-ab33-6bbed30e2e1d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115062024-11-15T21:56:46.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cb12d00a-59a7-48a5-9f10-559df45b4680 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115072024-11-15T21:56:46.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cb12d00a-59a7-48a5-9f10-559df45b4680 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115082024-11-15T21:56:46.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = cb12d00a-59a7-48a5-9f10-559df45b4680 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115092024-11-15T21:56:47.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8971bb6d-1883-46dd-97cd-c2c909f14a85 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115102024-11-15T21:56:47.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8971bb6d-1883-46dd-97cd-c2c909f14a85 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115112024-11-15T21:56:47.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8971bb6d-1883-46dd-97cd-c2c909f14a85 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115122024-11-15T21:56:48.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 833a5a81-0141-4fd9-9d8c-81c44fb9e744 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115132024-11-15T21:56:48.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 833a5a81-0141-4fd9-9d8c-81c44fb9e744 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115142024-11-15T21:56:49.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 833a5a81-0141-4fd9-9d8c-81c44fb9e744 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115152024-11-15T21:56:50.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d74c492d-ada2-4719-9d34-eb4cb8b41daf roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115162024-11-15T21:56:50.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d74c492d-ada2-4719-9d34-eb4cb8b41daf resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115172024-11-15T21:56:50.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d74c492d-ada2-4719-9d34-eb4cb8b41daf response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115182024-11-15T21:56:51.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 59c73946-0720-469e-8181-251612d8c6a4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115192024-11-15T21:56:51.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 59c73946-0720-469e-8181-251612d8c6a4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115202024-11-15T21:56:51.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 59c73946-0720-469e-8181-251612d8c6a4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115212024-11-15T21:56:52.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 11a52564-fe8b-4670-b40c-53276b9c04bf roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115222024-11-15T21:56:52.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 11a52564-fe8b-4670-b40c-53276b9c04bf resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115232024-11-15T21:56:52.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 11a52564-fe8b-4670-b40c-53276b9c04bf response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
115242024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
115252024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
115262024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115272024-11-15T21:56:52.974ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
115282024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
115292024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
115302024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
115312024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115322024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
115332024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115342024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
115352024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115362024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
115372024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
115382024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115392024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
115402024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
115412024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115422024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
115432024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115442024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
115452024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
115462024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
115472024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115482024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
115492024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
115502024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115512024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
115522024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
115532024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
115542024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
115552024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115562024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
115572024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
115582024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
115592024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115602024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115612024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115622024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115632024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115642024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115652024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115662024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115672024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
115682024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115692024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115702024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
115712024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115722024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115732024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115742024-11-15T21:56:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
115752024-11-15T21:56:52.975ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115762024-11-15T21:56:52.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115772024-11-15T21:56:52.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115782024-11-15T21:56:52.977ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115792024-11-15T21:56:52.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115802024-11-15T21:56:52.978ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.868195ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
115812024-11-15T21:56:52.978ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115822024-11-15T21:56:52.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115832024-11-15T21:56:52.979ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115842024-11-15T21:56:52.979ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
115852024-11-15T21:56:52.979ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115862024-11-15T21:56:52.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
115872024-11-15T21:56:52.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115882024-11-15T21:56:52.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115892024-11-15T21:56:52.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115902024-11-15T21:56:52.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
115912024-11-15T21:56:52.980ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
115922024-11-15T21:56:52.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115932024-11-15T21:56:52.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115942024-11-15T21:56:52.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115952024-11-15T21:56:52.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115962024-11-15T21:56:52.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115972024-11-15T21:56:52.982ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115982024-11-15T21:56:52.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
115992024-11-15T21:56:52.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116002024-11-15T21:56:52.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116012024-11-15T21:56:52.983ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1894, tv_nsec: 982378451 } })
116022024-11-15T21:56:52.983ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
116032024-11-15T21:56:52.984ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1894, tv_nsec: 983481218 } })
116042024-11-15T21:56:52.984ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116052024-11-15T21:56:52.984ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
116062024-11-15T21:56:52.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
116072024-11-15T21:56:52.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116082024-11-15T21:56:52.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116092024-11-15T21:56:52.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116102024-11-15T21:56:52.987ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116112024-11-15T21:56:52.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116122024-11-15T21:56:52.988ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.909767ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
116132024-11-15T21:56:52.989ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.516291ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116142024-11-15T21:56:52.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116152024-11-15T21:56:52.990ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116162024-11-15T21:56:52.990ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
116172024-11-15T21:56:52.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116182024-11-15T21:56:52.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116192024-11-15T21:56:52.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116202024-11-15T21:56:52.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116212024-11-15T21:56:52.992ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
116222024-11-15T21:56:52.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116232024-11-15T21:56:52.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116242024-11-15T21:56:52.996ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1894, tv_nsec: 992215845 } })
116252024-11-15T21:56:52.996ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116262024-11-15T21:56:52.996ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
116272024-11-15T21:56:52.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116282024-11-15T21:56:52.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116292024-11-15T21:56:52.999ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
116302024-11-15T21:56:52.999ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 25.505015ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
116312024-11-15T21:56:52.999ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116322024-11-15T21:56:53.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116332024-11-15T21:56:53.001ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116342024-11-15T21:56:53.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
116352024-11-15T21:56:53.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116362024-11-15T21:56:53.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116372024-11-15T21:56:53.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116382024-11-15T21:56:53.005ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116392024-11-15T21:56:53.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116402024-11-15T21:56:53.016ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 42.409575ms iteration = 34 status = {"physical_disks_added":0}
116412024-11-15T21:56:53.022ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
116422024-11-15T21:56:53.022ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.273333ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
116432024-11-15T21:56:53.023ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116442024-11-15T21:56:53.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116452024-11-15T21:56:53.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.367907ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
116462024-11-15T21:56:53.026ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
116472024-11-15T21:56:53.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
116482024-11-15T21:56:53.029ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
116492024-11-15T21:56:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
116502024-11-15T21:56:53.030ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116512024-11-15T21:56:53.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
116522024-11-15T21:56:53.040ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116532024-11-15T21:56:53.040ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
116542024-11-15T21:56:53.040ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 66.809794ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
116552024-11-15T21:56:53.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116562024-11-15T21:56:53.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116572024-11-15T21:56:53.092ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
116582024-11-15T21:56:53.092ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116592024-11-15T21:56:53.092ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea9de0b6-4999-4be1-8be8-0943fdee2dd2", "content-length": "26", "date": "Fri, 15 Nov 2024 21:56:52 GMT"} })
116602024-11-15T21:56:53.092ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116612024-11-15T21:56:53.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fb21fcd2-59da-4c4b-b111-967161bd2012 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
116622024-11-15T21:56:53.095ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116632024-11-15T21:56:53.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fb21fcd2-59da-4c4b-b111-967161bd2012 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
116642024-11-15T21:56:53.099ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
116652024-11-15T21:56:53.099ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116662024-11-15T21:56:53.099ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0b36183-7083-4a81-83fa-61d64a1fd315", "content-length": "26", "date": "Fri, 15 Nov 2024 21:56:52 GMT"} })
116672024-11-15T21:56:53.099ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116682024-11-15T21:56:53.101ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116692024-11-15T21:56:53.102ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
116702024-11-15T21:56:53.102ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116712024-11-15T21:56:53.102ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03ac4b21-1f10-46b5-ab5f-28786845d8c3", "content-length": "26", "date": "Fri, 15 Nov 2024 21:56:52 GMT"} })
116722024-11-15T21:56:53.102ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116732024-11-15T21:56:53.104ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
116742024-11-15T21:56:53.119ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
116752024-11-15T21:56:53.119ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116762024-11-15T21:56:53.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116772024-11-15T21:56:53.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116782024-11-15T21:56:53.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fb21fcd2-59da-4c4b-b111-967161bd2012 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
116792024-11-15T21:56:53.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116802024-11-15T21:56:53.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
116812024-11-15T21:56:53.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116822024-11-15T21:56:53.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116832024-11-15T21:56:53.128ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 155.051627ms iteration = 30 status = 0
116842024-11-15T21:56:53.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 175.291028ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
116852024-11-15T21:56:53.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 175.987083ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
116862024-11-15T21:56:53.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 176.583936ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
116872024-11-15T21:56:53.194ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
116882024-11-15T21:56:53.195ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "12af9e23-fdd9-4f5e-85bc-0b6174036c17", "content-length": "2", "date": "Fri, 15 Nov 2024 21:56:53 GMT"} })
116892024-11-15T21:56:53.196ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116902024-11-15T21:56:53.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116912024-11-15T21:56:53.198ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 225.985607ms iteration = 30 status = null
116922024-11-15T21:56:53.204ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 231.05325ms iteration = 30 status = {}
116932024-11-15T21:56:53.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116942024-11-15T21:56:53.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116952024-11-15T21:56:53.214ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bd53a60-dfc3-4d00-9499-acaf052a303b", "content-length": "372", "date": "Fri, 15 Nov 2024 21:56:53 GMT"} })
116962024-11-15T21:56:53.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116972024-11-15T21:56:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116982024-11-15T21:56:53.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116992024-11-15T21:56:53.239ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
117002024-11-15T21:56:53.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117012024-11-15T21:56:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117022024-11-15T21:56:53.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117032024-11-15T21:56:53.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
117042024-11-15T21:56:53.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117052024-11-15T21:56:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117062024-11-15T21:56:53.259ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
117072024-11-15T21:56:53.259ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
117082024-11-15T21:56:53.259ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f562a2a8-5550-438a-b702-3e5dc97901ff", "date": "Fri, 15 Nov 2024 21:56:53 GMT"} })
117092024-11-15T21:56:53.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117102024-11-15T21:56:53.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117112024-11-15T21:56:53.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117122024-11-15T21:56:53.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117132024-11-15T21:56:53.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117142024-11-15T21:56:53.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117152024-11-15T21:56:53.266ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
117162024-11-15T21:56:53.266ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
117172024-11-15T21:56:53.266ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "174f6ceb-b547-4167-b183-d0ca05aed39a", "date": "Fri, 15 Nov 2024 21:56:53 GMT"} })
117182024-11-15T21:56:53.268ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 295.80288ms iteration = 32 status = {}
117192024-11-15T21:56:53.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117202024-11-15T21:56:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117212024-11-15T21:56:53.298ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
117222024-11-15T21:56:53.298ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "86b3cdc7-e09b-4216-9eb5-7e5441f2cb4b", "content-length": "691", "date": "Fri, 15 Nov 2024 21:56:53 GMT"} })
117232024-11-15T21:56:53.298ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
117242024-11-15T21:56:53.298ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
117252024-11-15T21:56:53.298ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
117262024-11-15T21:56:53.299ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
117272024-11-15T21:56:53.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117282024-11-15T21:56:53.300ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 327.609136ms iteration = 31 status = {}
117292024-11-15T21:56:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117302024-11-15T21:56:53.308ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
117312024-11-15T21:56:53.308ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a196fe0-e870-4d96-b7c6-cb1af0f5da8d", "content-length": "134", "date": "Fri, 15 Nov 2024 21:56:53 GMT"} })
117322024-11-15T21:56:53.308ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
117332024-11-15T21:56:53.308ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
117342024-11-15T21:56:53.309ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
117352024-11-15T21:56:53.309ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
117362024-11-15T21:56:53.309ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117372024-11-15T21:56:53.309ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117382024-11-15T21:56:53.309ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117392024-11-15T21:56:53.309ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
117402024-11-15T21:56:53.309ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117412024-11-15T21:56:53.309ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
117422024-11-15T21:56:53.309ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
117432024-11-15T21:56:53.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117442024-11-15T21:56:53.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117452024-11-15T21:56:53.311ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
117462024-11-15T21:56:53.311ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9270f45-385a-4cdf-b854-0a808ea76028", "content-length": "2", "date": "Fri, 15 Nov 2024 21:56:53 GMT"} })
117472024-11-15T21:56:53.311ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
117482024-11-15T21:56:53.311ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcd50043-b9a1-422e-9261-185dbacbf87b", "content-length": "52", "date": "Fri, 15 Nov 2024 21:56:53 GMT"} })
117492024-11-15T21:56:53.311ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
117502024-11-15T21:56:53.311ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
117512024-11-15T21:56:53.418ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f2dd0140-12b5-405c-8a36-e37b5c782b70", "date": "Fri, 15 Nov 2024 21:56:53 GMT"} })
117522024-11-15T21:56:53.418ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
117532024-11-15T21:56:53.418ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
117542024-11-15T21:56:53.418ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "028a4c1a-78f6-4e8f-8cc7-083dd818e393", "content-length": "682", "date": "Fri, 15 Nov 2024 21:56:53 GMT"} })
117552024-11-15T21:56:53.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117562024-11-15T21:56:53.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117572024-11-15T21:56:53.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117582024-11-15T21:56:53.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117592024-11-15T21:56:53.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117602024-11-15T21:56:53.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117612024-11-15T21:56:53.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117622024-11-15T21:56:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117632024-11-15T21:56:53.435ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 463.942671ms iteration = 30 status = {}
117642024-11-15T21:56:54.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d269732b-ec87-4b22-9cf7-efa9a349430a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117652024-11-15T21:56:54.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d269732b-ec87-4b22-9cf7-efa9a349430a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117662024-11-15T21:56:54.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d269732b-ec87-4b22-9cf7-efa9a349430a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117672024-11-15T21:56:54.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = f0be631f-0141-4c6e-9119-ccaa81624db2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
117682024-11-15T21:56:54.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = f0be631f-0141-4c6e-9119-ccaa81624db2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
117692024-11-15T21:56:54.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = f0be631f-0141-4c6e-9119-ccaa81624db2 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
117702024-11-15T21:56:55.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31fc8c09-229f-4892-a89b-c7e88e39a250 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117712024-11-15T21:56:55.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31fc8c09-229f-4892-a89b-c7e88e39a250 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117722024-11-15T21:56:55.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31fc8c09-229f-4892-a89b-c7e88e39a250 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117732024-11-15T21:56:56.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5aaedfaf-0736-41d5-8c66-d58ea54be73b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117742024-11-15T21:56:56.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5aaedfaf-0736-41d5-8c66-d58ea54be73b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117752024-11-15T21:56:56.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 5aaedfaf-0736-41d5-8c66-d58ea54be73b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117762024-11-15T21:56:57.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3fa7315-3e31-4ba0-bece-4ec974483d88 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117772024-11-15T21:56:57.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3fa7315-3e31-4ba0-bece-4ec974483d88 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117782024-11-15T21:56:57.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b3fa7315-3e31-4ba0-bece-4ec974483d88 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117792024-11-15T21:56:58.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 787adaad-dc61-43b7-b7ba-bfacf17b837a roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117802024-11-15T21:56:58.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 787adaad-dc61-43b7-b7ba-bfacf17b837a resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117812024-11-15T21:56:58.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 787adaad-dc61-43b7-b7ba-bfacf17b837a response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117822024-11-15T21:56:59.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1e2ef2d9-210c-4ee4-8fbb-13463321460e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117832024-11-15T21:56:59.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1e2ef2d9-210c-4ee4-8fbb-13463321460e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117842024-11-15T21:56:59.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 1e2ef2d9-210c-4ee4-8fbb-13463321460e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117852024-11-15T21:57:00.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8cb7104f-a9ce-4784-862d-911b8eb9c5b5 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117862024-11-15T21:57:00.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8cb7104f-a9ce-4784-862d-911b8eb9c5b5 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117872024-11-15T21:57:00.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8cb7104f-a9ce-4784-862d-911b8eb9c5b5 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117882024-11-15T21:57:00.592ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1403 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = c191994f-76f3-4a7e-8b4e-6f3778e0c439 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
117892024-11-15T21:57:01.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d8b44cb5-ae86-4da0-8e9c-13f448c00370 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117902024-11-15T21:57:01.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d8b44cb5-ae86-4da0-8e9c-13f448c00370 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117912024-11-15T21:57:01.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d8b44cb5-ae86-4da0-8e9c-13f448c00370 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117922024-11-15T21:57:02.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b4aab79b-88f4-4727-a5af-9dc8b34f665b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117932024-11-15T21:57:02.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b4aab79b-88f4-4727-a5af-9dc8b34f665b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117942024-11-15T21:57:02.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = b4aab79b-88f4-4727-a5af-9dc8b34f665b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
117952024-11-15T21:57:02.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
117962024-11-15T21:57:02.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
117972024-11-15T21:57:02.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117982024-11-15T21:57:02.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117992024-11-15T21:57:02.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118002024-11-15T21:57:02.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118012024-11-15T21:57:02.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118022024-11-15T21:57:02.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118032024-11-15T21:57:02.949ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118042024-11-15T21:57:02.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118052024-11-15T21:57:02.951ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118062024-11-15T21:57:02.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118072024-11-15T21:57:02.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118082024-11-15T21:57:02.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
118092024-11-15T21:57:02.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118102024-11-15T21:57:02.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118112024-11-15T21:57:02.966ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
118122024-11-15T21:57:02.966ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.946053ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
118132024-11-15T21:57:02.974ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118142024-11-15T21:57:02.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118152024-11-15T21:57:03.002ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.682425ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118162024-11-15T21:57:03.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 525fe6ae-8a1a-4b3a-9fa3-7a9dfc865cc6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118172024-11-15T21:57:03.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 525fe6ae-8a1a-4b3a-9fa3-7a9dfc865cc6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118182024-11-15T21:57:03.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 525fe6ae-8a1a-4b3a-9fa3-7a9dfc865cc6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118192024-11-15T21:57:04.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8e9e7540-46fc-49c0-9cc4-7dda6ef927d6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118202024-11-15T21:57:04.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8e9e7540-46fc-49c0-9cc4-7dda6ef927d6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118212024-11-15T21:57:04.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8e9e7540-46fc-49c0-9cc4-7dda6ef927d6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118222024-11-15T21:57:05.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 60a39209-c08c-4612-b116-29440e0351aa roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118232024-11-15T21:57:05.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 60a39209-c08c-4612-b116-29440e0351aa resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118242024-11-15T21:57:05.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 60a39209-c08c-4612-b116-29440e0351aa response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118252024-11-15T21:57:05.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 1eb99091-e2c9-4f9a-bb3d-11384a4d4751 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
118262024-11-15T21:57:05.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 1eb99091-e2c9-4f9a-bb3d-11384a4d4751 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
118272024-11-15T21:57:05.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = 1eb99091-e2c9-4f9a-bb3d-11384a4d4751 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?sort_by=id_ascending
118282024-11-15T21:57:05.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = abd2bafc-5cf0-45bc-938f-774e17c60816 roles = RoleSet { roles: {} } uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
118292024-11-15T21:57:05.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = abd2bafc-5cf0-45bc-938f-774e17c60816 resource = Database result = Ok(()) uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
118302024-11-15T21:57:05.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40566 req_id = abd2bafc-5cf0-45bc-938f-774e17c60816 response_code = 200 uri = /metrics/collectors/5ef543c6-773f-4453-b7c6-1ba24a407ceb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYThjZTlhYy01NDI3LTQzZTMtYjcxYS1hMTU4OTU1MzMwZGYifX0%3D
118312024-11-15T21:57:06.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c758b17a-69f0-4315-bfab-d3ab3c387461 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118322024-11-15T21:57:06.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c758b17a-69f0-4315-bfab-d3ab3c387461 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118332024-11-15T21:57:06.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c758b17a-69f0-4315-bfab-d3ab3c387461 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118342024-11-15T21:57:07.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a71bd82c-44f5-4c53-ace7-4b1872d1504e roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118352024-11-15T21:57:07.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a71bd82c-44f5-4c53-ace7-4b1872d1504e resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118362024-11-15T21:57:07.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = a71bd82c-44f5-4c53-ace7-4b1872d1504e response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118372024-11-15T21:57:08.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 53c42f04-2063-4fce-987c-0cc69093d700 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118382024-11-15T21:57:08.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 53c42f04-2063-4fce-987c-0cc69093d700 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118392024-11-15T21:57:08.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 53c42f04-2063-4fce-987c-0cc69093d700 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118402024-11-15T21:57:09.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b656fc2-0441-4c01-8bd6-365a06705305 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118412024-11-15T21:57:09.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b656fc2-0441-4c01-8bd6-365a06705305 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118422024-11-15T21:57:09.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9b656fc2-0441-4c01-8bd6-365a06705305 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118432024-11-15T21:57:10.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d0687bef-6b4b-48ff-a68a-d9c8bc6e30dd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118442024-11-15T21:57:10.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d0687bef-6b4b-48ff-a68a-d9c8bc6e30dd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118452024-11-15T21:57:10.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = d0687bef-6b4b-48ff-a68a-d9c8bc6e30dd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118462024-11-15T21:57:11.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 812a7971-703e-4b32-864b-99cbd23a70fe roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118472024-11-15T21:57:11.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 812a7971-703e-4b32-864b-99cbd23a70fe resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118482024-11-15T21:57:11.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 812a7971-703e-4b32-864b-99cbd23a70fe response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118492024-11-15T21:57:12.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9f8fcd48-4b95-4fe2-ad88-c0a10f3b00f6 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118502024-11-15T21:57:12.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9f8fcd48-4b95-4fe2-ad88-c0a10f3b00f6 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118512024-11-15T21:57:12.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9f8fcd48-4b95-4fe2-ad88-c0a10f3b00f6 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118522024-11-15T21:57:12.952ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
118532024-11-15T21:57:12.952ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118542024-11-15T21:57:12.952ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
118552024-11-15T21:57:12.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118562024-11-15T21:57:12.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118572024-11-15T21:57:12.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118582024-11-15T21:57:12.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118592024-11-15T21:57:12.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118602024-11-15T21:57:12.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118612024-11-15T21:57:12.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118622024-11-15T21:57:12.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118632024-11-15T21:57:12.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118642024-11-15T21:57:12.981ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118652024-11-15T21:57:12.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118662024-11-15T21:57:12.983ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.197322ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118672024-11-15T21:57:12.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118682024-11-15T21:57:12.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
118692024-11-15T21:57:12.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118702024-11-15T21:57:12.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118712024-11-15T21:57:13.006ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
118722024-11-15T21:57:13.006ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.93668ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
118732024-11-15T21:57:13.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 825ca819-ee42-4b15-9930-66f22774273d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118742024-11-15T21:57:13.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 825ca819-ee42-4b15-9930-66f22774273d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118752024-11-15T21:57:13.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 825ca819-ee42-4b15-9930-66f22774273d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118762024-11-15T21:57:14.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c8910aa3-cbba-41cc-b454-023d8ee182f8 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118772024-11-15T21:57:14.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c8910aa3-cbba-41cc-b454-023d8ee182f8 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118782024-11-15T21:57:14.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = c8910aa3-cbba-41cc-b454-023d8ee182f8 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118792024-11-15T21:57:15.601ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1550 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = 34168d3c-961c-47bd-8449-e14b71388eb6 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
118802024-11-15T21:57:15.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e641f12e-271d-4db1-8e99-349663db5e47 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118812024-11-15T21:57:15.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e641f12e-271d-4db1-8e99-349663db5e47 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118822024-11-15T21:57:15.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e641f12e-271d-4db1-8e99-349663db5e47 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118832024-11-15T21:57:16.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 59f974fb-e93c-40c2-87f3-7656a0acd745 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118842024-11-15T21:57:16.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 59f974fb-e93c-40c2-87f3-7656a0acd745 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118852024-11-15T21:57:16.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 59f974fb-e93c-40c2-87f3-7656a0acd745 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118862024-11-15T21:57:17.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3d59dbc-0656-4b08-ab44-f09c2b734ff4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118872024-11-15T21:57:17.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3d59dbc-0656-4b08-ab44-f09c2b734ff4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118882024-11-15T21:57:17.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = f3d59dbc-0656-4b08-ab44-f09c2b734ff4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118892024-11-15T21:57:18.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9790a9d0-cb1d-4600-b04a-2ac85ad762bc roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118902024-11-15T21:57:18.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9790a9d0-cb1d-4600-b04a-2ac85ad762bc resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118912024-11-15T21:57:18.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9790a9d0-cb1d-4600-b04a-2ac85ad762bc response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118922024-11-15T21:57:19.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9e4d95dc-3aa2-418b-8aab-41323ff79d62 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118932024-11-15T21:57:19.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9e4d95dc-3aa2-418b-8aab-41323ff79d62 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118942024-11-15T21:57:19.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 9e4d95dc-3aa2-418b-8aab-41323ff79d62 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118952024-11-15T21:57:20.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31a3895c-63b2-48f9-892c-3a75566613fd roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118962024-11-15T21:57:20.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31a3895c-63b2-48f9-892c-3a75566613fd resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118972024-11-15T21:57:20.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 31a3895c-63b2-48f9-892c-3a75566613fd response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118982024-11-15T21:57:21.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad2e40e5-1b65-4922-9163-b7c2bbf45da0 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
118992024-11-15T21:57:21.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad2e40e5-1b65-4922-9163-b7c2bbf45da0 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
119002024-11-15T21:57:21.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = ad2e40e5-1b65-4922-9163-b7c2bbf45da0 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
119012024-11-15T21:57:22.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4fdfc538-07be-4576-a5f0-7c26ffc93d3b roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
119022024-11-15T21:57:22.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4fdfc538-07be-4576-a5f0-7c26ffc93d3b resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
119032024-11-15T21:57:22.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4fdfc538-07be-4576-a5f0-7c26ffc93d3b response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
119042024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
119052024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
119062024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119072024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
119082024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
119092024-11-15T21:57:22.979ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
119102024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
119112024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
119122024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119132024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119142024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
119152024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119162024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
119172024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
119182024-11-15T21:57:22.979ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
119192024-11-15T21:57:22.979ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-15 21:47:22.979847006 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
119202024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
119212024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
119222024-11-15T21:57:22.979ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
119232024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
119242024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119252024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119262024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
119272024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
119282024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
119292024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
119302024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
119312024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
119322024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
119332024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
119342024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
119352024-11-15T21:57:22.980ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
119362024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
119372024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
119382024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
119392024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119402024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
119412024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119422024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
119432024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
119442024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
119452024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
119462024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
119472024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
119482024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
119492024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119502024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
119512024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
119522024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
119532024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
119542024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119552024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
119562024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119572024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
119582024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
119592024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119602024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
119612024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119622024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
119632024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
119642024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
119652024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
119662024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
119672024-11-15T21:57:22.980ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9
119682024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119692024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
119702024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.98\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9"}
119712024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119722024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
119732024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119742024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119752024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119762024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
119772024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
119782024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
119792024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
119802024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
119812024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119822024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119832024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
119842024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
119852024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
119862024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
119872024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119882024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119892024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
119902024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119912024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
119922024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119932024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119942024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119952024-11-15T21:57:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119962024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
119972024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119982024-11-15T21:57:22.981ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("457f990d-f83f-40bb-8721-4e2b5314e3a3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5804ddd8-8ad1-42d2-89d7-fdb66142b4f2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edd0c7a0-e093-44a9-845e-02d5df012651.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1924, tv_nsec: 974618585 } })
119992024-11-15T21:57:22.981ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e055384-7079-47b2-95bf-5191a730e1f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d27385ac-d3f8-425a-9c62-c86cb4a78778.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1924, tv_nsec: 974630016 } })
120002024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120012024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120022024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120032024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120042024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120052024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120062024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120072024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
120082024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.48558ms iteration = 17 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
120092024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
120102024-11-15T21:57:22.981ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.937062ms iteration = 17 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
120112024-11-15T21:57:22.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120122024-11-15T21:57:22.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120132024-11-15T21:57:22.983ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120142024-11-15T21:57:22.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120152024-11-15T21:57:22.985ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1924, tv_nsec: 979140395 } })
120162024-11-15T21:57:22.985ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.462225ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
120172024-11-15T21:57:22.985ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
120182024-11-15T21:57:22.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
120192024-11-15T21:57:22.986ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
120202024-11-15T21:57:22.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
120212024-11-15T21:57:22.988ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
120222024-11-15T21:57:22.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120232024-11-15T21:57:22.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120242024-11-15T21:57:22.990ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-15 21:47:22.979847006 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
120252024-11-15T21:57:22.990ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.396168ms iteration = 16 status = {"expiration":"2024-11-15T21:47:22.979847006Z","pruned":[]}
120262024-11-15T21:57:22.990ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
120272024-11-15T21:57:22.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120282024-11-15T21:57:22.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
120292024-11-15T21:57:22.993ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.738399ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
120302024-11-15T21:57:22.994ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1924, tv_nsec: 987648910 } })
120312024-11-15T21:57:22.994ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
120322024-11-15T21:57:22.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120332024-11-15T21:57:22.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120342024-11-15T21:57:22.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120352024-11-15T21:57:22.996ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120362024-11-15T21:57:22.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120372024-11-15T21:57:22.996ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120382024-11-15T21:57:22.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120392024-11-15T21:57:23.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
120402024-11-15T21:57:23.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
120412024-11-15T21:57:23.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
120422024-11-15T21:57:23.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
120432024-11-15T21:57:23.001ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120442024-11-15T21:57:23.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120452024-11-15T21:57:23.004ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120462024-11-15T21:57:23.004ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120472024-11-15T21:57:23.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
120482024-11-15T21:57:23.008ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120492024-11-15T21:57:23.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120502024-11-15T21:57:23.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
120512024-11-15T21:57:23.008ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120522024-11-15T21:57:23.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120532024-11-15T21:57:23.010ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120542024-11-15T21:57:23.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
120552024-11-15T21:57:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
120562024-11-15T21:57:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
120572024-11-15T21:57:23.013ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120582024-11-15T21:57:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120592024-11-15T21:57:23.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
120602024-11-15T21:57:23.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
120612024-11-15T21:57:23.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120622024-11-15T21:57:23.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
120632024-11-15T21:57:23.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120642024-11-15T21:57:23.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.523176ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
120652024-11-15T21:57:23.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120662024-11-15T21:57:23.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120672024-11-15T21:57:23.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
120682024-11-15T21:57:23.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120692024-11-15T21:57:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120702024-11-15T21:57:23.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120712024-11-15T21:57:23.049ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120722024-11-15T21:57:23.051ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
120732024-11-15T21:57:23.051ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
120742024-11-15T21:57:23.051ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.85162ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
120752024-11-15T21:57:23.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120762024-11-15T21:57:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
120772024-11-15T21:57:23.052ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120782024-11-15T21:57:23.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120792024-11-15T21:57:23.055ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
120802024-11-15T21:57:23.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120812024-11-15T21:57:23.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
120822024-11-15T21:57:23.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120832024-11-15T21:57:23.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
120842024-11-15T21:57:23.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
120852024-11-15T21:57:23.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
120862024-11-15T21:57:23.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
120872024-11-15T21:57:23.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120882024-11-15T21:57:23.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 81.015256ms iteration = 31 status = {"errors":[],"records_set_to_done":[]}
120892024-11-15T21:57:23.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
120902024-11-15T21:57:23.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120912024-11-15T21:57:23.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120922024-11-15T21:57:23.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120932024-11-15T21:57:23.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120942024-11-15T21:57:23.062ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120952024-11-15T21:57:23.062ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
120962024-11-15T21:57:23.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120972024-11-15T21:57:23.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120982024-11-15T21:57:23.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120992024-11-15T21:57:23.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
121002024-11-15T21:57:23.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121012024-11-15T21:57:23.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121022024-11-15T21:57:23.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121032024-11-15T21:57:23.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
121042024-11-15T21:57:23.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121052024-11-15T21:57:23.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121062024-11-15T21:57:23.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.678469ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
121072024-11-15T21:57:23.068ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
121082024-11-15T21:57:23.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
121092024-11-15T21:57:23.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121102024-11-15T21:57:23.070ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121112024-11-15T21:57:23.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.081212ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121122024-11-15T21:57:23.071ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-78d47478-5af8-488d-89c5-11be23443b63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1925, tv_nsec: 65296564 } })
121132024-11-15T21:57:23.072ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
121142024-11-15T21:57:23.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
121152024-11-15T21:57:23.072ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121162024-11-15T21:57:23.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121172024-11-15T21:57:23.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
121182024-11-15T21:57:23.073ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121192024-11-15T21:57:23.073ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
121202024-11-15T21:57:23.073ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
121212024-11-15T21:57:23.073ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.672888ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
121222024-11-15T21:57:23.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121232024-11-15T21:57:23.074ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121242024-11-15T21:57:23.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121252024-11-15T21:57:23.075ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121262024-11-15T21:57:23.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121272024-11-15T21:57:23.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
121282024-11-15T21:57:23.077ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121292024-11-15T21:57:23.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121302024-11-15T21:57:23.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
121312024-11-15T21:57:23.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
121322024-11-15T21:57:23.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
121332024-11-15T21:57:23.080ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
121342024-11-15T21:57:23.080ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
121352024-11-15T21:57:23.080ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
121362024-11-15T21:57:23.080ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121372024-11-15T21:57:23.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121382024-11-15T21:57:23.081ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121392024-11-15T21:57:23.081ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
121402024-11-15T21:57:23.081ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 101.108237ms iteration = 7 status = {"nsuccess":5}
121412024-11-15T21:57:23.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
121422024-11-15T21:57:23.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121432024-11-15T21:57:23.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
121442024-11-15T21:57:23.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
121452024-11-15T21:57:23.084ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121462024-11-15T21:57:23.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121472024-11-15T21:57:23.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121482024-11-15T21:57:23.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121492024-11-15T21:57:23.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
121502024-11-15T21:57:23.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121512024-11-15T21:57:23.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121522024-11-15T21:57:23.087ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
121532024-11-15T21:57:23.087ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.055495ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
121542024-11-15T21:57:23.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
121552024-11-15T21:57:23.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
121562024-11-15T21:57:23.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
121572024-11-15T21:57:23.089ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
121582024-11-15T21:57:23.089ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 0 version = 2
121592024-11-15T21:57:23.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121602024-11-15T21:57:23.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121612024-11-15T21:57:23.089ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121622024-11-15T21:57:23.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121632024-11-15T21:57:23.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121642024-11-15T21:57:23.091ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121652024-11-15T21:57:23.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121662024-11-15T21:57:23.091ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
121672024-11-15T21:57:23.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121682024-11-15T21:57:23.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
121692024-11-15T21:57:23.094ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
121702024-11-15T21:57:23.094ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121712024-11-15T21:57:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121722024-11-15T21:57:23.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121732024-11-15T21:57:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121742024-11-15T21:57:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121752024-11-15T21:57:23.096ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
121762024-11-15T21:57:23.096ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
121772024-11-15T21:57:23.096ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
121782024-11-15T21:57:23.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121792024-11-15T21:57:23.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121802024-11-15T21:57:23.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121812024-11-15T21:57:23.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121822024-11-15T21:57:23.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
121832024-11-15T21:57:23.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
121842024-11-15T21:57:23.097ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 234f8cf6-c5a6-429a-b94e-d9156216a1ef dns_zone_name = oxide.test found_so_far = 1 version = 2
121852024-11-15T21:57:23.097ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
121862024-11-15T21:57:23.097ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-15 21:42:25.192306 UTC dns_group = external generation = 2
121872024-11-15T21:57:23.097ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 117.687574ms iteration = 17 status = {"generation":2}
121882024-11-15T21:57:23.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121892024-11-15T21:57:23.098ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121902024-11-15T21:57:23.099ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
121912024-11-15T21:57:23.099ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.70172ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
121922024-11-15T21:57:23.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
121932024-11-15T21:57:23.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
121942024-11-15T21:57:23.101ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
121952024-11-15T21:57:23.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
121962024-11-15T21:57:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
121972024-11-15T21:57:23.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121982024-11-15T21:57:23.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121992024-11-15T21:57:23.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
122002024-11-15T21:57:23.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122012024-11-15T21:57:23.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122022024-11-15T21:57:23.107ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 127.403007ms iteration = 31 status = 0
122032024-11-15T21:57:23.108ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
122042024-11-15T21:57:23.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
122052024-11-15T21:57:23.112ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122062024-11-15T21:57:23.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122072024-11-15T21:57:23.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 133.458326ms iteration = 31 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
122082024-11-15T21:57:23.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122092024-11-15T21:57:23.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122102024-11-15T21:57:23.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122112024-11-15T21:57:23.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122122024-11-15T21:57:23.117ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
122132024-11-15T21:57:23.117ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122142024-11-15T21:57:23.118ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eace8bbf-e79b-4bd7-b79c-dcd36ebf3c97", "content-length": "26", "date": "Fri, 15 Nov 2024 21:57:22 GMT"} })
122152024-11-15T21:57:23.118ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122162024-11-15T21:57:23.121ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122172024-11-15T21:57:23.126ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122182024-11-15T21:57:23.126ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
122192024-11-15T21:57:23.126ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122202024-11-15T21:57:23.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122212024-11-15T21:57:23.142ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
122222024-11-15T21:57:23.148ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
122232024-11-15T21:57:23.148ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
122242024-11-15T21:57:23.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122252024-11-15T21:57:23.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122262024-11-15T21:57:23.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122272024-11-15T21:57:23.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122282024-11-15T21:57:23.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122292024-11-15T21:57:23.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122302024-11-15T21:57:23.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122312024-11-15T21:57:23.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122322024-11-15T21:57:23.156ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 175.811211ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
122332024-11-15T21:57:23.158ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
122342024-11-15T21:57:23.160ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-15T21:42:19.430444Z, time_modified: 2024-11-15T21:42:19.430444Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, db_silo: Silo { identity: SiloIdentity { id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-15T21:42:25.139718Z, time_modified: 2024-11-15T21:42:25.139718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743" }] }) }
122352024-11-15T21:57:23.160ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 180.2201ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]}},"default_endpoint":{"silo_id":"dba2ea2d-2632-4f3f-a3b4-c59c04735431","tls_certs":["e9bb741dca9337139cd465e019b7787aa6d39674a492b87ad74308c225d47743"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
122362024-11-15T21:57:23.161ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122372024-11-15T21:57:23.161ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
122382024-11-15T21:57:23.161ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 181.117856ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
122392024-11-15T21:57:23.163ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122402024-11-15T21:57:23.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122412024-11-15T21:57:23.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122422024-11-15T21:57:23.183ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
122432024-11-15T21:57:23.183ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122442024-11-15T21:57:23.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
122452024-11-15T21:57:23.183ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122462024-11-15T21:57:23.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122472024-11-15T21:57:23.184ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b23060c-abfc-4826-966b-5e41f8a0266e", "content-length": "26", "date": "Fri, 15 Nov 2024 21:57:22 GMT"} })
122482024-11-15T21:57:23.184ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122492024-11-15T21:57:23.186ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122502024-11-15T21:57:23.223ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 242.671945ms iteration = 35 status = {"physical_disks_added":0}
122512024-11-15T21:57:23.225ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
122522024-11-15T21:57:23.225ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 244.411707ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
122532024-11-15T21:57:23.288ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
122542024-11-15T21:57:23.288ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122552024-11-15T21:57:23.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122562024-11-15T21:57:23.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122572024-11-15T21:57:23.295ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9557ff27-5efc-49ed-87e9-eb7e0fe1c830 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
122582024-11-15T21:57:23.295ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
122592024-11-15T21:57:23.295ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-15 21:42:23.736354 UTC dns_group = internal generation = 1
122602024-11-15T21:57:23.295ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 314.891384ms iteration = 17 status = {"generation":1}
122612024-11-15T21:57:23.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122622024-11-15T21:57:23.296ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122632024-11-15T21:57:23.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122642024-11-15T21:57:23.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
122652024-11-15T21:57:23.297ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122662024-11-15T21:57:23.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122672024-11-15T21:57:23.299ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122682024-11-15T21:57:23.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122692024-11-15T21:57:23.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122702024-11-15T21:57:23.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122712024-11-15T21:57:23.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122722024-11-15T21:57:23.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122732024-11-15T21:57:23.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122742024-11-15T21:57:23.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122752024-11-15T21:57:23.304ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
122762024-11-15T21:57:23.304ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "79a06213-7e05-4013-98c9-4de574c0d14a", "content-length": "2", "date": "Fri, 15 Nov 2024 21:57:22 GMT"} })
122772024-11-15T21:57:23.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122782024-11-15T21:57:23.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122792024-11-15T21:57:23.305ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122802024-11-15T21:57:23.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122812024-11-15T21:57:23.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122822024-11-15T21:57:23.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122832024-11-15T21:57:23.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122842024-11-15T21:57:23.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122852024-11-15T21:57:23.307ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 327.100073ms iteration = 31 status = null
122862024-11-15T21:57:23.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122872024-11-15T21:57:23.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122882024-11-15T21:57:23.345ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
122892024-11-15T21:57:23.345ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 364.338894ms iteration = 31 status = {}
122902024-11-15T21:57:23.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122912024-11-15T21:57:23.349ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
122922024-11-15T21:57:23.349ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122932024-11-15T21:57:23.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122942024-11-15T21:57:23.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122952024-11-15T21:57:23.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122962024-11-15T21:57:23.352ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
122972024-11-15T21:57:23.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
122982024-11-15T21:57:23.353ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122992024-11-15T21:57:23.358ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
123002024-11-15T21:57:23.358ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123012024-11-15T21:57:23.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123022024-11-15T21:57:23.362ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123032024-11-15T21:57:23.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123042024-11-15T21:57:23.364ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123052024-11-15T21:57:23.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123062024-11-15T21:57:23.366ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123072024-11-15T21:57:23.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123082024-11-15T21:57:23.368ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 zone_address = fd00:1122:3344:101::2
123092024-11-15T21:57:23.368ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123102024-11-15T21:57:23.368ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c20ec3c-98e9-406f-a68b-a96d8756ca22", "content-length": "26", "date": "Fri, 15 Nov 2024 21:57:22 GMT"} })
123112024-11-15T21:57:23.368ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123122024-11-15T21:57:23.368ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123132024-11-15T21:57:23.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123142024-11-15T21:57:23.369ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
123152024-11-15T21:57:23.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123162024-11-15T21:57:23.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123172024-11-15T21:57:23.392ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
123182024-11-15T21:57:23.392ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0ecce250-b5e5-4dc5-be8d-d17d496302ec", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
123192024-11-15T21:57:23.392ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
123202024-11-15T21:57:23.394ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0a470971-e1ff-44f2-b24b-f754eeaee72f", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
123212024-11-15T21:57:23.394ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
123222024-11-15T21:57:23.396ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
123232024-11-15T21:57:23.396ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 415.637268ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
123242024-11-15T21:57:23.401ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "84094a78-f22d-47b5-90bf-c72bd139cd0a", "content-length": "372", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} })
123252024-11-15T21:57:23.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123262024-11-15T21:57:23.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123272024-11-15T21:57:23.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123282024-11-15T21:57:23.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123292024-11-15T21:57:23.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123302024-11-15T21:57:23.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123312024-11-15T21:57:23.410ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123322024-11-15T21:57:23.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
123332024-11-15T21:57:23.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123342024-11-15T21:57:23.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123352024-11-15T21:57:23.417ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123362024-11-15T21:57:23.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123372024-11-15T21:57:23.437ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
123382024-11-15T21:57:23.438ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "44d0102e-d713-48fa-8d3a-a1f7e084d019", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123392024-11-15T21:57:23.438ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123402024-11-15T21:57:23.440ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "693bf676-e2d9-4966-94bb-c14e984461bf", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123412024-11-15T21:57:23.440ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123422024-11-15T21:57:23.441ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e2413e38-7ddd-4a93-a057-d96b9f1a81cf", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123432024-11-15T21:57:23.441ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123442024-11-15T21:57:23.443ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
123452024-11-15T21:57:23.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 462.25393ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
123462024-11-15T21:57:23.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123472024-11-15T21:57:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123482024-11-15T21:57:23.448ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
123492024-11-15T21:57:23.448ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
123502024-11-15T21:57:23.449ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9ed7d070-68be-4bdb-a703-81bb73a3f312", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} })
123512024-11-15T21:57:23.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123522024-11-15T21:57:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123532024-11-15T21:57:23.452ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
123542024-11-15T21:57:23.452ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "02fae301-416c-4806-9b73-c2baf249259f", "content-length": "691", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} })
123552024-11-15T21:57:23.452ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
123562024-11-15T21:57:23.452ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
123572024-11-15T21:57:23.452ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
123582024-11-15T21:57:23.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123592024-11-15T21:57:23.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123602024-11-15T21:57:23.454ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 473.345133ms iteration = 32 status = {}
123612024-11-15T21:57:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123622024-11-15T21:57:23.457ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
123632024-11-15T21:57:23.457ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123642024-11-15T21:57:23.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123652024-11-15T21:57:23.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123662024-11-15T21:57:23.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123672024-11-15T21:57:23.463ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
123682024-11-15T21:57:23.463ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123692024-11-15T21:57:23.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123702024-11-15T21:57:23.463ZINFOnexus (BackgroundTasks): VPC route manager sled 78d47478-5af8-488d-89c5-11be23443b63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
123712024-11-15T21:57:23.463ZDEBGnexus (BackgroundTasks): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123722024-11-15T21:57:23.464ZDEBGnexus (BackgroundTasks): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f506f298-ddb0-441d-987f-4b3b307318f5", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} })
123732024-11-15T21:57:23.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123742024-11-15T21:57:23.466ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 485.24413ms iteration = 33 status = {}
123752024-11-15T21:57:23.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
123762024-11-15T21:57:23.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
123772024-11-15T21:57:23.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
123782024-11-15T21:57:23.468ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
123792024-11-15T21:57:23.468ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
123802024-11-15T21:57:23.468ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
123812024-11-15T21:57:23.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123822024-11-15T21:57:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123832024-11-15T21:57:23.515ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 79839008-c347-488f-be8d-5f92f4ee52d6, rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(86ac9333-276b-4978-b845-b80ffe802486) } rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
123842024-11-15T21:57:23.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123852024-11-15T21:57:23.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123862024-11-15T21:57:23.525ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
123872024-11-15T21:57:23.526ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b3b166c-ca4d-4f96-8aaf-e0be023caab6", "content-length": "134", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} })
123882024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
123892024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 86ac9333-276b-4978-b845-b80ffe802486
123902024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
123912024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
123922024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123932024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123942024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123952024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123962024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123972024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123982024-11-15T21:57:23.526ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967
123992024-11-15T21:57:23.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124002024-11-15T21:57:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124012024-11-15T21:57:23.528ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
124022024-11-15T21:57:23.528ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4811b46-25d7-4f25-bdea-df48bcea6ee0", "content-length": "2", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} })
124032024-11-15T21:57:23.528ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
124042024-11-15T21:57:23.528ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5253363-8401-4774-b99a-215b0e63b69f", "content-length": "52", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} })
124052024-11-15T21:57:23.528ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch_location = Switch0
124062024-11-15T21:57:23.528ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
124072024-11-15T21:57:23.577ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 78d47478-5af8-488d-89c5-11be23443b63, time_created: 2024-11-15T21:42:21.206118Z, time_modified: 2024-11-15T21:42:21.206118Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
124082024-11-15T21:57:23.577ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
124092024-11-15T21:57:23.577ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
124102024-11-15T21:57:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
124112024-11-15T21:57:23.580ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
124122024-11-15T21:57:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
124132024-11-15T21:57:23.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124142024-11-15T21:57:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 78d47478-5af8-488d-89c5-11be23443b63, lookup_type: ById(78d47478-5af8-488d-89c5-11be23443b63) } result = Ok(())
124152024-11-15T21:57:23.616ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
124162024-11-15T21:57:23.700ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b7ac84c8-763c-43b8-94ba-d17bf76b831a", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} })
124172024-11-15T21:57:23.700ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 switch = Switch0
124182024-11-15T21:57:23.700ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
124192024-11-15T21:57:23.700ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ddfb397a-b658-4566-9e9b-db5e51d8a967 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aa7730f-bafd-4388-81fe-3e9261c59597", "content-length": "682", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} })
124202024-11-15T21:57:23.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124212024-11-15T21:57:23.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124222024-11-15T21:57:23.701ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 78d47478-5af8-488d-89c5-11be23443b63 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "6351fc17-fce7-4ef3-9d05-2562e6b7584a", "date": "Fri, 15 Nov 2024 21:57:23 GMT"} })
124232024-11-15T21:57:23.702ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
124242024-11-15T21:57:23.702ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 720.94127ms
124252024-11-15T21:57:23.702ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 720.95401ms iteration = 4 status = {}
124262024-11-15T21:57:23.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124272024-11-15T21:57:23.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124282024-11-15T21:57:23.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124292024-11-15T21:57:23.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124302024-11-15T21:57:23.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124312024-11-15T21:57:23.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124322024-11-15T21:57:23.717ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 735.410724ms iteration = 31 status = {}
124332024-11-15T21:57:23.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bbbfd645-cd35-428c-b43c-9b73311d14fb roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124342024-11-15T21:57:23.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bbbfd645-cd35-428c-b43c-9b73311d14fb resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124352024-11-15T21:57:23.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = bbbfd645-cd35-428c-b43c-9b73311d14fb response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124362024-11-15T21:57:24.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 1f16016f-0c87-4021-81a3-953450953dc3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
124372024-11-15T21:57:24.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 1f16016f-0c87-4021-81a3-953450953dc3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
124382024-11-15T21:57:24.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47802 req_id = 1f16016f-0c87-4021-81a3-953450953dc3 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
124392024-11-15T21:57:24.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4ff7f4ff-3f3c-4234-b5ad-aa162742cfe1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124402024-11-15T21:57:24.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4ff7f4ff-3f3c-4234-b5ad-aa162742cfe1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124412024-11-15T21:57:24.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 4ff7f4ff-3f3c-4234-b5ad-aa162742cfe1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124422024-11-15T21:57:26.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 51364dc0-8266-4961-836f-fd88400b99b1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124432024-11-15T21:57:26.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 51364dc0-8266-4961-836f-fd88400b99b1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124442024-11-15T21:57:26.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 51364dc0-8266-4961-836f-fd88400b99b1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124452024-11-15T21:57:27.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 04001837-7ca7-4e68-ae81-1443bcb01ab1 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124462024-11-15T21:57:27.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 04001837-7ca7-4e68-ae81-1443bcb01ab1 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124472024-11-15T21:57:27.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 04001837-7ca7-4e68-ae81-1443bcb01ab1 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124482024-11-15T21:57:27.223ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
124492024-11-15T21:57:27.223ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
124502024-11-15T21:57:27.254ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
124512024-11-15T21:57:27.254ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:52629
124522024-11-15T21:57:27.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:52629 req_id = a22dcacb-6475-4366-8827-d7c760852bdf roles = RoleSet { roles: {} } uri = /metrics/producers
124532024-11-15T21:57:27.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:52629 req_id = a22dcacb-6475-4366-8827-d7c760852bdf resource = Database result = Ok(()) uri = /metrics/producers
124542024-11-15T21:57:27.294ZINFOnexus: assigned collector to new producer collector_id = 5ef543c6-773f-4453-b7c6-1ba24a407ceb file = nexus/src/app/oximeter.rs:76 producer_id = 5a7571a8-c048-48d8-a4d1-00692f1c218e
124552024-11-15T21:57:27.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40047 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:52629 req_id = a22dcacb-6475-4366-8827-d7c760852bdf response_code = 201 uri = /metrics/producers
124562024-11-15T21:57:27.294ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "a22dcacb-6475-4366-8827-d7c760852bdf", "content-length": "41", "date": "Fri, 15 Nov 2024 21:57:27 GMT"} })
124572024-11-15T21:57:27.296ZDEBGnexus (producer-registration-task): registered with nexus successfully
124582024-11-15T21:57:27.296ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
124592024-11-15T21:57:28.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 54db7a1d-7bd1-430e-b039-e93371433f4c roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124602024-11-15T21:57:28.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 54db7a1d-7bd1-430e-b039-e93371433f4c resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124612024-11-15T21:57:28.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 54db7a1d-7bd1-430e-b039-e93371433f4c response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124622024-11-15T21:57:29.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fed0e676-fb67-4677-bf96-9b47f8e7f5d4 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124632024-11-15T21:57:29.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fed0e676-fb67-4677-bf96-9b47f8e7f5d4 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124642024-11-15T21:57:29.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = fed0e676-fb67-4677-bf96-9b47f8e7f5d4 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124652024-11-15T21:57:30.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 08dbe077-b33e-41db-b3d8-66eb38fad455 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124662024-11-15T21:57:30.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 08dbe077-b33e-41db-b3d8-66eb38fad455 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124672024-11-15T21:57:30.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 08dbe077-b33e-41db-b3d8-66eb38fad455 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124682024-11-15T21:57:30.641ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1721 local_addr = [fd00:1122:3344:101::b]:48001 method = GET remote_addr = [fd00:1122:3344:101::d]:46769 req_id = d5608c8f-fb85-4007-a314-58eeedd1d9c2 response_code = 200 uri = /5a7571a8-c048-48d8-a4d1-00692f1c218e
124692024-11-15T21:57:31.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e8007d59-ec0d-4da1-a4be-19c65012252d roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124702024-11-15T21:57:31.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e8007d59-ec0d-4da1-a4be-19c65012252d resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124712024-11-15T21:57:31.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = e8007d59-ec0d-4da1-a4be-19c65012252d response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124722024-11-15T21:57:32.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 79fb254f-6c6a-4cd3-a917-8ec3bb540ee2 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124732024-11-15T21:57:32.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 79fb254f-6c6a-4cd3-a917-8ec3bb540ee2 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124742024-11-15T21:57:32.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 79fb254f-6c6a-4cd3-a917-8ec3bb540ee2 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124752024-11-15T21:57:33.006ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
124762024-11-15T21:57:33.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124772024-11-15T21:57:33.006ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
124782024-11-15T21:57:33.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124792024-11-15T21:57:33.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124802024-11-15T21:57:33.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124812024-11-15T21:57:33.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124822024-11-15T21:57:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124832024-11-15T21:57:33.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124842024-11-15T21:57:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124852024-11-15T21:57:33.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124862024-11-15T21:57:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124872024-11-15T21:57:33.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124882024-11-15T21:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124892024-11-15T21:57:33.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124902024-11-15T21:57:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 25ff3bdd-004e-4cfd-9805-fca397ba7ba9, lookup_type: ById(25ff3bdd-004e-4cfd-9805-fca397ba7ba9) } result = Ok(())
124912024-11-15T21:57:33.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124922024-11-15T21:57:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124932024-11-15T21:57:33.030ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 original_time_created = 2024-11-15 21:42:12.436211 UTC target_id = 25ff3bdd-004e-4cfd-9805-fca397ba7ba9 time_created = 2024-11-15 21:42:12.436211 UTC
124942024-11-15T21:57:33.030ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.553873ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"25ff3bdd-004e-4cfd-9805-fca397ba7ba9","time_created":"2024-11-15T21:42:12.436211Z"}
124952024-11-15T21:57:33.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.488418ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124962024-11-15T21:57:33.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8140c2e0-b19e-4e2d-a868-ade7d22c6f04 roles = RoleSet { roles: {} } uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124972024-11-15T21:57:33.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8140c2e0-b19e-4e2d-a868-ade7d22c6f04 resource = Database result = Ok(()) uri = /probes/78d47478-5af8-488d-89c5-11be23443b63
124982024-11-15T21:57:33.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49634 req_id = 8140c2e0-b19e-4e2d-a868-ade7d22c6f04 response_code = 200 uri = /probes/78d47478-5af8-488d-89c5-11be23443b63