Max level shown:
12024-11-05T00:00:00.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1636f68c-359c-4819-8394-4e4eaed6ffd7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
22024-11-05T00:00:00.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1636f68c-359c-4819-8394-4e4eaed6ffd7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
32024-11-05T00:00:00.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1636f68c-359c-4819-8394-4e4eaed6ffd7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
42024-11-05T00:00:01.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c14dfded-6565-4f45-9bfc-bb77aac74358 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
52024-11-05T00:00:01.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c14dfded-6565-4f45-9bfc-bb77aac74358 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
62024-11-05T00:00:01.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c14dfded-6565-4f45-9bfc-bb77aac74358 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
72024-11-05T00:00:02.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
82024-11-05T00:00:02.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92024-11-05T00:00:02.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
102024-11-05T00:00:02.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112024-11-05T00:00:02.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122024-11-05T00:00:02.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132024-11-05T00:00:02.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142024-11-05T00:00:02.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
152024-11-05T00:00:02.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
162024-11-05T00:00:02.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
172024-11-05T00:00:02.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
182024-11-05T00:00:02.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192024-11-05T00:00:02.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
202024-11-05T00:00:02.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
212024-11-05T00:00:02.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222024-11-05T00:00:02.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
232024-11-05T00:00:02.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
242024-11-05T00:00:02.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
252024-11-05T00:00:02.203ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
262024-11-05T00:00:02.203ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.58747ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
272024-11-05T00:00:02.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.186526ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
282024-11-05T00:00:02.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d3cd1060-9443-40a9-af28-f9a56a63d1b1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
292024-11-05T00:00:02.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d3cd1060-9443-40a9-af28-f9a56a63d1b1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
302024-11-05T00:00:02.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d3cd1060-9443-40a9-af28-f9a56a63d1b1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
312024-11-05T00:00:03.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2653c8b4-baa8-4a30-93b7-0d81bc144c20 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
322024-11-05T00:00:03.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2653c8b4-baa8-4a30-93b7-0d81bc144c20 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
332024-11-05T00:00:03.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2653c8b4-baa8-4a30-93b7-0d81bc144c20 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
342024-11-05T00:00:04.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e10c328f-50de-4723-85be-e9b34127c8a9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
352024-11-05T00:00:04.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e10c328f-50de-4723-85be-e9b34127c8a9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
362024-11-05T00:00:04.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e10c328f-50de-4723-85be-e9b34127c8a9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
372024-11-05T00:00:05.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4d6ec817-bc40-42b1-a577-4a1b06c1b239 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
382024-11-05T00:00:05.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4d6ec817-bc40-42b1-a577-4a1b06c1b239 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
392024-11-05T00:00:05.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4d6ec817-bc40-42b1-a577-4a1b06c1b239 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
402024-11-05T00:00:06.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1631eb97-16bd-4416-8f21-77ca8f9265ae roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
412024-11-05T00:00:06.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1631eb97-16bd-4416-8f21-77ca8f9265ae resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
422024-11-05T00:00:06.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1631eb97-16bd-4416-8f21-77ca8f9265ae response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
432024-11-05T00:00:06.878ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 901 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 70965e66-0eda-46ba-bca6-594f269dc7dd response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
442024-11-05T00:00:07.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 40e79735-89d0-4184-9f6b-a2b80ff8afe6 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
452024-11-05T00:00:07.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 40e79735-89d0-4184-9f6b-a2b80ff8afe6 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
462024-11-05T00:00:07.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 40e79735-89d0-4184-9f6b-a2b80ff8afe6 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
472024-11-05T00:00:08.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 59d1a5fa-c2fa-4293-b6ca-d3795cc42868 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
482024-11-05T00:00:08.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 59d1a5fa-c2fa-4293-b6ca-d3795cc42868 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
492024-11-05T00:00:08.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 59d1a5fa-c2fa-4293-b6ca-d3795cc42868 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
502024-11-05T00:00:09.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 75796bdd-3996-4083-8f46-4496524d8e62 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
512024-11-05T00:00:09.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 75796bdd-3996-4083-8f46-4496524d8e62 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
522024-11-05T00:00:09.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 75796bdd-3996-4083-8f46-4496524d8e62 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
532024-11-05T00:00:10.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7f4dcc21-3cc7-41a5-b1ef-1af6cc9abbf9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
542024-11-05T00:00:10.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7f4dcc21-3cc7-41a5-b1ef-1af6cc9abbf9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
552024-11-05T00:00:10.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7f4dcc21-3cc7-41a5-b1ef-1af6cc9abbf9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
562024-11-05T00:00:11.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 8c9c529a-46ad-412c-8c5a-0258d04e9b7c roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
572024-11-05T00:00:11.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 8c9c529a-46ad-412c-8c5a-0258d04e9b7c resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
582024-11-05T00:00:11.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 8c9c529a-46ad-412c-8c5a-0258d04e9b7c response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
592024-11-05T00:00:11.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 1390c658-4134-4d53-b931-8dff1c26dab3 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
602024-11-05T00:00:11.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 1390c658-4134-4d53-b931-8dff1c26dab3 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
612024-11-05T00:00:11.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 1390c658-4134-4d53-b931-8dff1c26dab3 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
622024-11-05T00:00:11.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fcb22621-aea4-4e13-884f-5de11377f9e8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
632024-11-05T00:00:11.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fcb22621-aea4-4e13-884f-5de11377f9e8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
642024-11-05T00:00:11.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fcb22621-aea4-4e13-884f-5de11377f9e8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
652024-11-05T00:00:12.169ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
662024-11-05T00:00:12.169ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
672024-11-05T00:00:12.169ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
682024-11-05T00:00:12.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
692024-11-05T00:00:12.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
702024-11-05T00:00:12.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
712024-11-05T00:00:12.169ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
722024-11-05T00:00:12.169ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
732024-11-05T00:00:12.169ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
742024-11-05T00:00:12.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
752024-11-05T00:00:12.169ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
762024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
772024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
782024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
792024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
802024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
812024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
822024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
832024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
842024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
852024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
862024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
872024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
882024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
892024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
902024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
912024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
922024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
932024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
942024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
952024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
962024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
972024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
982024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
992024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1002024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1012024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1022024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1032024-11-05T00:00:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1042024-11-05T00:00:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
1052024-11-05T00:00:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
1062024-11-05T00:00:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
1072024-11-05T00:00:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.451\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
1082024-11-05T00:00:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.811\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1092024-11-05T00:00:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.24\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1102024-11-05T00:00:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
1112024-11-05T00:00:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.06\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
1122024-11-05T00:00:12.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1132024-11-05T00:00:12.173ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2655, tv_nsec: 762064788 } })
1142024-11-05T00:00:12.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1152024-11-05T00:00:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.669905ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1162024-11-05T00:00:12.173ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
1172024-11-05T00:00:12.174ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2655, tv_nsec: 763232152 } })
1182024-11-05T00:00:12.174ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
1192024-11-05T00:00:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1202024-11-05T00:00:12.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1212024-11-05T00:00:12.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1222024-11-05T00:00:12.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1232024-11-05T00:00:12.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1242024-11-05T00:00:12.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1252024-11-05T00:00:12.177ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1262024-11-05T00:00:12.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1272024-11-05T00:00:12.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1282024-11-05T00:00:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1292024-11-05T00:00:12.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1302024-11-05T00:00:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1312024-11-05T00:00:12.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1322024-11-05T00:00:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1332024-11-05T00:00:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1342024-11-05T00:00:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1352024-11-05T00:00:12.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1362024-11-05T00:00:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1372024-11-05T00:00:12.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1382024-11-05T00:00:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1392024-11-05T00:00:12.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1402024-11-05T00:00:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1412024-11-05T00:00:12.194ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2655, tv_nsec: 782677202 } })
1422024-11-05T00:00:12.194ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
1432024-11-05T00:00:12.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1442024-11-05T00:00:12.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1452024-11-05T00:00:12.196ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1462024-11-05T00:00:12.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1472024-11-05T00:00:12.199ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1482024-11-05T00:00:12.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1492024-11-05T00:00:12.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1502024-11-05T00:00:12.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1512024-11-05T00:00:12.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.011015ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1522024-11-05T00:00:12.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1532024-11-05T00:00:12.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1542024-11-05T00:00:12.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.451665ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1552024-11-05T00:00:12.221ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1562024-11-05T00:00:12.221ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1572024-11-05T00:00:12.221ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1582024-11-05T00:00:12.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1592024-11-05T00:00:12.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1602024-11-05T00:00:12.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1612024-11-05T00:00:12.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1622024-11-05T00:00:12.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1632024-11-05T00:00:12.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1642024-11-05T00:00:12.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1652024-11-05T00:00:12.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1662024-11-05T00:00:12.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1672024-11-05T00:00:12.233ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1682024-11-05T00:00:12.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1692024-11-05T00:00:12.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1702024-11-05T00:00:12.234ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
1712024-11-05T00:00:12.234ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1722024-11-05T00:00:12.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1732024-11-05T00:00:12.234ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c838a9ca-bdf9-4509-b36a-535340cc1795", "content-length": "26", "date": "Tue, 05 Nov 2024 00:00:12 GMT"} })
1742024-11-05T00:00:12.234ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1752024-11-05T00:00:12.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
1762024-11-05T00:00:12.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1772024-11-05T00:00:12.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1782024-11-05T00:00:12.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1792024-11-05T00:00:12.234ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1802024-11-05T00:00:12.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1812024-11-05T00:00:12.235ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
1822024-11-05T00:00:12.235ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1832024-11-05T00:00:12.235ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10209d4b-d67a-421e-986f-50a2a2b7d142", "content-length": "26", "date": "Tue, 05 Nov 2024 00:00:12 GMT"} })
1842024-11-05T00:00:12.235ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1852024-11-05T00:00:12.236ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1862024-11-05T00:00:12.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1872024-11-05T00:00:12.238ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1882024-11-05T00:00:12.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
1892024-11-05T00:00:12.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1902024-11-05T00:00:12.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1912024-11-05T00:00:12.242ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 72.59815ms iteration = 12 status = 0
1922024-11-05T00:00:12.252ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
1932024-11-05T00:00:12.252ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.821ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
1942024-11-05T00:00:12.256ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1952024-11-05T00:00:12.256ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1962024-11-05T00:00:12.256ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1972024-11-05T00:00:12.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1982024-11-05T00:00:12.282ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1992024-11-05T00:00:12.283ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.090871ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2002024-11-05T00:00:12.287ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
2012024-11-05T00:00:12.287ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2022024-11-05T00:00:12.287ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2032024-11-05T00:00:12.287ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3971ce04-11e6-4e19-9af8-00be458ab180", "content-length": "26", "date": "Tue, 05 Nov 2024 00:00:12 GMT"} })
2042024-11-05T00:00:12.287ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2052024-11-05T00:00:12.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2062024-11-05T00:00:12.289ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2072024-11-05T00:00:12.289ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
2082024-11-05T00:00:12.290ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2092024-11-05T00:00:12.290ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2102024-11-05T00:00:12.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2112024-11-05T00:00:12.292ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2122024-11-05T00:00:12.294ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2132024-11-05T00:00:12.294ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2142024-11-05T00:00:12.294ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.560187ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2152024-11-05T00:00:12.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2162024-11-05T00:00:12.295ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2172024-11-05T00:00:12.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2182024-11-05T00:00:12.317ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 147.341634ms iteration = 14 status = {"physical_disks_added":0}
2192024-11-05T00:00:12.342ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 172.330777ms iteration = 12 status = {}
2202024-11-05T00:00:12.343ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2212024-11-05T00:00:12.343ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "13926f5f-0b16-4430-ad19-ecd5012c9316", "content-length": "1", "date": "Tue, 05 Nov 2024 00:00:11 GMT"} })
2222024-11-05T00:00:12.345ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2232024-11-05T00:00:12.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2242024-11-05T00:00:12.348ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 178.253409ms iteration = 12 status = null
2252024-11-05T00:00:12.406ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2262024-11-05T00:00:12.407ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fc56006-847f-466f-a4d4-3334e8a51b97", "content-length": "691", "date": "Tue, 05 Nov 2024 00:00:12 GMT"} })
2272024-11-05T00:00:12.407ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
2282024-11-05T00:00:12.407ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2292024-11-05T00:00:12.407ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2302024-11-05T00:00:12.407ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2312024-11-05T00:00:12.407ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2322024-11-05T00:00:12.407ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a35a4d9-487d-42d7-94cf-bfb38686ca8d", "content-length": "372", "date": "Tue, 05 Nov 2024 00:00:12 GMT"} })
2332024-11-05T00:00:12.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2342024-11-05T00:00:12.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2352024-11-05T00:00:12.408ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 238.23451ms iteration = 12 status = {}
2362024-11-05T00:00:12.463ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
2372024-11-05T00:00:12.464ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2382024-11-05T00:00:12.464ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bcc9c247-346e-4537-be12-e43b116a6d3b", "date": "Tue, 05 Nov 2024 00:00:12 GMT"} })
2392024-11-05T00:00:12.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2402024-11-05T00:00:12.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2412024-11-05T00:00:12.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2422024-11-05T00:00:12.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2432024-11-05T00:00:12.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2442024-11-05T00:00:12.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2452024-11-05T00:00:12.477ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2462024-11-05T00:00:12.477ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2472024-11-05T00:00:12.477ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4cf40beb-38c8-44a2-81e5-451713e2e9b1", "date": "Tue, 05 Nov 2024 00:00:12 GMT"} })
2482024-11-05T00:00:12.479ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 309.589495ms iteration = 12 status = {}
2492024-11-05T00:00:12.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2502024-11-05T00:00:12.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2512024-11-05T00:00:12.487ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
2522024-11-05T00:00:12.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2532024-11-05T00:00:12.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2542024-11-05T00:00:12.500ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2552024-11-05T00:00:12.501ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "03d18811-dfa6-4c3b-8e9e-d59ec678b6d1", "content-length": "134", "date": "Tue, 05 Nov 2024 00:00:11 GMT"} })
2562024-11-05T00:00:12.501ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2572024-11-05T00:00:12.501ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
2582024-11-05T00:00:12.501ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2592024-11-05T00:00:12.501ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2602024-11-05T00:00:12.501ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2612024-11-05T00:00:12.501ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2622024-11-05T00:00:12.501ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2632024-11-05T00:00:12.501ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2642024-11-05T00:00:12.501ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2652024-11-05T00:00:12.501ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2662024-11-05T00:00:12.502ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
2672024-11-05T00:00:12.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2682024-11-05T00:00:12.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2692024-11-05T00:00:12.504ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2702024-11-05T00:00:12.504ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2151224b-194a-478a-b789-031e3fa9ea5a", "content-length": "2", "date": "Tue, 05 Nov 2024 00:00:11 GMT"} })
2712024-11-05T00:00:12.504ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2722024-11-05T00:00:12.505ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d1b824a-7837-465f-8b97-e550c2b3b092", "content-length": "52", "date": "Tue, 05 Nov 2024 00:00:11 GMT"} })
2732024-11-05T00:00:12.505ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
2742024-11-05T00:00:12.505ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2752024-11-05T00:00:12.609ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "961b73e0-a14f-4567-aa1f-3f2b851cc4a8", "date": "Tue, 05 Nov 2024 00:00:12 GMT"} })
2762024-11-05T00:00:12.609ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
2772024-11-05T00:00:12.609ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2782024-11-05T00:00:12.690ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "38fc84f6-ce1b-4a1f-aee8-2a6b52dad792", "content-length": "682", "date": "Tue, 05 Nov 2024 00:00:12 GMT"} })
2792024-11-05T00:00:12.690ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2802024-11-05T00:00:12.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2812024-11-05T00:00:12.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2822024-11-05T00:00:12.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2832024-11-05T00:00:12.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2842024-11-05T00:00:12.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2852024-11-05T00:00:12.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2862024-11-05T00:00:12.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2872024-11-05T00:00:12.709ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 539.963194ms iteration = 12 status = {}
2882024-11-05T00:00:12.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 226cebed-f76a-4d5f-b97e-babd3270483c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2892024-11-05T00:00:12.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 226cebed-f76a-4d5f-b97e-babd3270483c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2902024-11-05T00:00:12.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 226cebed-f76a-4d5f-b97e-babd3270483c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2912024-11-05T00:00:13.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 726221ca-a5be-489e-95e7-30b1703f705e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2922024-11-05T00:00:13.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 726221ca-a5be-489e-95e7-30b1703f705e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2932024-11-05T00:00:14.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 726221ca-a5be-489e-95e7-30b1703f705e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2942024-11-05T00:00:15.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4103f947-c05a-4cff-87ef-1200cd10b5c6 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2952024-11-05T00:00:15.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4103f947-c05a-4cff-87ef-1200cd10b5c6 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2962024-11-05T00:00:15.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4103f947-c05a-4cff-87ef-1200cd10b5c6 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2972024-11-05T00:00:16.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 101fcafc-ba34-4f92-917e-40ba15fba182 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2982024-11-05T00:00:16.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 101fcafc-ba34-4f92-917e-40ba15fba182 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2992024-11-05T00:00:16.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 101fcafc-ba34-4f92-917e-40ba15fba182 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3002024-11-05T00:00:17.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d862d18d-62db-4a0a-941a-99718372af29 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3012024-11-05T00:00:17.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d862d18d-62db-4a0a-941a-99718372af29 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3022024-11-05T00:00:17.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d862d18d-62db-4a0a-941a-99718372af29 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3032024-11-05T00:00:18.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cae7856a-bf74-4195-8d0f-ef98903a3fbf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3042024-11-05T00:00:18.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cae7856a-bf74-4195-8d0f-ef98903a3fbf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3052024-11-05T00:00:18.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1755 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cae7856a-bf74-4195-8d0f-ef98903a3fbf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3062024-11-05T00:00:19.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b1e25c5a-7960-4bc7-99bf-601184fd6418 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3072024-11-05T00:00:19.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b1e25c5a-7960-4bc7-99bf-601184fd6418 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3082024-11-05T00:00:19.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b1e25c5a-7960-4bc7-99bf-601184fd6418 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3092024-11-05T00:00:20.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07df7ff7-15ce-4bfe-97d1-8c2739c62b8b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3102024-11-05T00:00:20.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07df7ff7-15ce-4bfe-97d1-8c2739c62b8b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3112024-11-05T00:00:20.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07df7ff7-15ce-4bfe-97d1-8c2739c62b8b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3122024-11-05T00:00:21.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7086381e-1144-43f8-99e2-96327ec2356b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3132024-11-05T00:00:21.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7086381e-1144-43f8-99e2-96327ec2356b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3142024-11-05T00:00:21.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7086381e-1144-43f8-99e2-96327ec2356b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3152024-11-05T00:00:21.878ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 542 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 39d1a45b-dfd4-477f-ade9-1a35741ea1d9 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
3162024-11-05T00:00:22.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
3172024-11-05T00:00:22.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
3182024-11-05T00:00:22.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3192024-11-05T00:00:22.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3202024-11-05T00:00:22.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3212024-11-05T00:00:22.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3222024-11-05T00:00:22.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3232024-11-05T00:00:22.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3242024-11-05T00:00:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3252024-11-05T00:00:22.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5c7ddb4b-1feb-4261-a177-9a0539c4143e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3262024-11-05T00:00:22.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3272024-11-05T00:00:22.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3282024-11-05T00:00:22.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5c7ddb4b-1feb-4261-a177-9a0539c4143e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3292024-11-05T00:00:22.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3302024-11-05T00:00:22.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5c7ddb4b-1feb-4261-a177-9a0539c4143e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3312024-11-05T00:00:22.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3322024-11-05T00:00:22.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3332024-11-05T00:00:22.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3342024-11-05T00:00:22.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
3352024-11-05T00:00:22.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3362024-11-05T00:00:22.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3372024-11-05T00:00:22.195ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
3382024-11-05T00:00:22.195ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.894051ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
3392024-11-05T00:00:22.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.293935ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3402024-11-05T00:00:23.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d63964f-953c-4105-82db-63a6bd800661 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3412024-11-05T00:00:23.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d63964f-953c-4105-82db-63a6bd800661 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3422024-11-05T00:00:23.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d63964f-953c-4105-82db-63a6bd800661 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3432024-11-05T00:00:24.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac947e8a-e2c7-4316-b21f-7fd2903a3313 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3442024-11-05T00:00:24.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac947e8a-e2c7-4316-b21f-7fd2903a3313 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3452024-11-05T00:00:24.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac947e8a-e2c7-4316-b21f-7fd2903a3313 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3462024-11-05T00:00:25.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9e595d57-d705-4146-9e85-ffd973272a08 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3472024-11-05T00:00:25.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9e595d57-d705-4146-9e85-ffd973272a08 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3482024-11-05T00:00:25.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9e595d57-d705-4146-9e85-ffd973272a08 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3492024-11-05T00:00:26.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8c487c4f-8118-4421-b421-708352f35163 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3502024-11-05T00:00:26.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8c487c4f-8118-4421-b421-708352f35163 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3512024-11-05T00:00:26.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8c487c4f-8118-4421-b421-708352f35163 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3522024-11-05T00:00:27.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 64f6808d-5388-43ef-a63b-2f9adbecc7aa roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3532024-11-05T00:00:27.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 64f6808d-5388-43ef-a63b-2f9adbecc7aa resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3542024-11-05T00:00:27.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 64f6808d-5388-43ef-a63b-2f9adbecc7aa response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3552024-11-05T00:00:28.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9ab35cb2-edda-4598-86bf-4a86f85be736 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3562024-11-05T00:00:28.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9ab35cb2-edda-4598-86bf-4a86f85be736 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3572024-11-05T00:00:28.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9ab35cb2-edda-4598-86bf-4a86f85be736 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3582024-11-05T00:00:29.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 456bdd90-a8bc-4897-9e09-6b02e3700e6f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3592024-11-05T00:00:29.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 456bdd90-a8bc-4897-9e09-6b02e3700e6f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3602024-11-05T00:00:29.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 456bdd90-a8bc-4897-9e09-6b02e3700e6f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3612024-11-05T00:00:30.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3d01e79d-4689-41fa-ae1e-10c052f8f395 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3622024-11-05T00:00:30.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3d01e79d-4689-41fa-ae1e-10c052f8f395 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3632024-11-05T00:00:30.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3d01e79d-4689-41fa-ae1e-10c052f8f395 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3642024-11-05T00:00:31.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d8a14cc0-7b32-48f6-8195-83c3deede2b6 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3652024-11-05T00:00:31.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d8a14cc0-7b32-48f6-8195-83c3deede2b6 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3662024-11-05T00:00:31.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d8a14cc0-7b32-48f6-8195-83c3deede2b6 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3672024-11-05T00:00:32.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
3682024-11-05T00:00:32.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3692024-11-05T00:00:32.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
3702024-11-05T00:00:32.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3712024-11-05T00:00:32.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3722024-11-05T00:00:32.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3732024-11-05T00:00:32.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3742024-11-05T00:00:32.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3752024-11-05T00:00:32.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3762024-11-05T00:00:32.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.94149ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3772024-11-05T00:00:32.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3782024-11-05T00:00:32.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3792024-11-05T00:00:32.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3802024-11-05T00:00:32.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3812024-11-05T00:00:32.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3822024-11-05T00:00:32.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3832024-11-05T00:00:32.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
3842024-11-05T00:00:32.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3852024-11-05T00:00:32.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3862024-11-05T00:00:32.189ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
3872024-11-05T00:00:32.189ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.681094ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
3882024-11-05T00:00:32.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = efa976fb-a3a0-4959-9994-4c10db7b3950 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3892024-11-05T00:00:32.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = efa976fb-a3a0-4959-9994-4c10db7b3950 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3902024-11-05T00:00:32.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = efa976fb-a3a0-4959-9994-4c10db7b3950 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3912024-11-05T00:00:33.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7cdd9d52-b1a9-45d6-982f-c23c1c160113 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3922024-11-05T00:00:33.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7cdd9d52-b1a9-45d6-982f-c23c1c160113 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3932024-11-05T00:00:33.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7cdd9d52-b1a9-45d6-982f-c23c1c160113 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3942024-11-05T00:00:34.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 64a56db2-727b-49b2-845e-c56797cfa73c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3952024-11-05T00:00:34.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 64a56db2-727b-49b2-845e-c56797cfa73c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3962024-11-05T00:00:34.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 64a56db2-727b-49b2-845e-c56797cfa73c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3972024-11-05T00:00:35.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ef1b8d53-d71d-4017-91b9-2b3fbd036c63 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3982024-11-05T00:00:35.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ef1b8d53-d71d-4017-91b9-2b3fbd036c63 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3992024-11-05T00:00:35.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ef1b8d53-d71d-4017-91b9-2b3fbd036c63 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4002024-11-05T00:00:36.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 931027f9-3bf9-4c13-b3e6-eb632182b9b4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4012024-11-05T00:00:36.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 931027f9-3bf9-4c13-b3e6-eb632182b9b4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4022024-11-05T00:00:36.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 931027f9-3bf9-4c13-b3e6-eb632182b9b4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4032024-11-05T00:00:36.876ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 717 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 5e61cede-f9f2-4b25-a1bd-dc7b7ec247a3 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
4042024-11-05T00:00:37.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 54414a79-2473-4e6e-a92b-07142fcd7ab2 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4052024-11-05T00:00:37.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 54414a79-2473-4e6e-a92b-07142fcd7ab2 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4062024-11-05T00:00:37.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 54414a79-2473-4e6e-a92b-07142fcd7ab2 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4072024-11-05T00:00:38.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2b81b9ea-a93c-4f97-b133-9e637b887fa4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4082024-11-05T00:00:38.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2b81b9ea-a93c-4f97-b133-9e637b887fa4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4092024-11-05T00:00:38.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2b81b9ea-a93c-4f97-b133-9e637b887fa4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4102024-11-05T00:00:39.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a5459eba-4fb1-463f-96b3-a60cce7640b9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4112024-11-05T00:00:39.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a5459eba-4fb1-463f-96b3-a60cce7640b9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4122024-11-05T00:00:39.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a5459eba-4fb1-463f-96b3-a60cce7640b9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4132024-11-05T00:00:40.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b2ca98da-d158-4e75-95c0-43793ef71c4e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4142024-11-05T00:00:40.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b2ca98da-d158-4e75-95c0-43793ef71c4e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4152024-11-05T00:00:40.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b2ca98da-d158-4e75-95c0-43793ef71c4e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4162024-11-05T00:00:41.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 60b66014-01ed-49b9-aaee-9e90eb3035f6 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4172024-11-05T00:00:41.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 60b66014-01ed-49b9-aaee-9e90eb3035f6 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4182024-11-05T00:00:41.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 60b66014-01ed-49b9-aaee-9e90eb3035f6 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4192024-11-05T00:00:42.169ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
4202024-11-05T00:00:42.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
4212024-11-05T00:00:42.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4222024-11-05T00:00:42.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
4232024-11-05T00:00:42.169ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
4242024-11-05T00:00:42.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4252024-11-05T00:00:42.169ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
4262024-11-05T00:00:42.169ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
4272024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
4282024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4292024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
4302024-11-05T00:00:42.170ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-04 23:50:42.169978128 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4312024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4322024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
4332024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
4342024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4352024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
4362024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4372024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4382024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
4392024-11-05T00:00:42.170ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4402024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4412024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4422024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
4432024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
4442024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4452024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
4462024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4472024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4482024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
4492024-11-05T00:00:42.170ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4502024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
4512024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4522024-11-05T00:00:42.170ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970
4532024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
4542024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.71\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970"}
4552024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4562024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4572024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
4582024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4592024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
4602024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
4612024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4622024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
4632024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4642024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4652024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
4662024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4672024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
4682024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
4692024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4702024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4712024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4722024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4732024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4742024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4752024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4762024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4772024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4782024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4792024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4802024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4812024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4822024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4832024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4842024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4852024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
4862024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
4872024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
4882024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.091\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
4892024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.831\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
4902024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.49\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
4912024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
4922024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
4932024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
4942024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4952024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4962024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.45\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
4972024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4982024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4992024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5002024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5012024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5022024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5032024-11-05T00:00:42.170ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f4c9dd5-dad6-4fc2-ba58-b064adbea295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2685, tv_nsec: 759234591 } })
5042024-11-05T00:00:42.170ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("08f058bf-bffa-4561-8799-2d5d32641d33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e5a3f00-3f5b-4cac-8aa4-99515a0afee2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2685, tv_nsec: 759240791 } })
5052024-11-05T00:00:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5062024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5072024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5082024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5092024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5102024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5112024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
5122024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.311837ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5132024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5142024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5152024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
5162024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.520731ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5172024-11-05T00:00:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5182024-11-05T00:00:42.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5192024-11-05T00:00:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.512611ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5202024-11-05T00:00:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5212024-11-05T00:00:42.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5222024-11-05T00:00:42.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5232024-11-05T00:00:42.174ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-04 23:50:42.169978128 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5242024-11-05T00:00:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.077354ms iteration = 7 status = {"expiration":"2024-11-04T23:50:42.169978128Z","pruned":[]}
5252024-11-05T00:00:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5262024-11-05T00:00:42.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5272024-11-05T00:00:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5282024-11-05T00:00:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5292024-11-05T00:00:42.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5302024-11-05T00:00:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5312024-11-05T00:00:42.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5322024-11-05T00:00:42.177ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2685, tv_nsec: 765740824 } })
5332024-11-05T00:00:42.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
5342024-11-05T00:00:42.177ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5352024-11-05T00:00:42.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5362024-11-05T00:00:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5372024-11-05T00:00:42.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5382024-11-05T00:00:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5392024-11-05T00:00:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5402024-11-05T00:00:42.180ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5412024-11-05T00:00:42.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5422024-11-05T00:00:42.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5432024-11-05T00:00:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5442024-11-05T00:00:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5452024-11-05T00:00:42.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5462024-11-05T00:00:42.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5472024-11-05T00:00:42.182ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5482024-11-05T00:00:42.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5492024-11-05T00:00:42.184ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2685, tv_nsec: 772468832 } })
5502024-11-05T00:00:42.184ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
5512024-11-05T00:00:42.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5522024-11-05T00:00:42.185ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5532024-11-05T00:00:42.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5542024-11-05T00:00:42.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5552024-11-05T00:00:42.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5562024-11-05T00:00:42.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5572024-11-05T00:00:42.190ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5582024-11-05T00:00:42.192ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.537382ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
5592024-11-05T00:00:42.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5602024-11-05T00:00:42.192ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5612024-11-05T00:00:42.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5622024-11-05T00:00:42.194ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632024-11-05T00:00:42.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5642024-11-05T00:00:42.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5652024-11-05T00:00:42.195ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662024-11-05T00:00:42.196ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5672024-11-05T00:00:42.197ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5682024-11-05T00:00:42.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5692024-11-05T00:00:42.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5702024-11-05T00:00:42.198ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2685, tv_nsec: 786421869 } })
5712024-11-05T00:00:42.198ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
5722024-11-05T00:00:42.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5732024-11-05T00:00:42.198ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5742024-11-05T00:00:42.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5752024-11-05T00:00:42.198ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762024-11-05T00:00:42.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5772024-11-05T00:00:42.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5782024-11-05T00:00:42.201ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5792024-11-05T00:00:42.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5802024-11-05T00:00:42.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5812024-11-05T00:00:42.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5822024-11-05T00:00:42.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5832024-11-05T00:00:42.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5842024-11-05T00:00:42.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5852024-11-05T00:00:42.219ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5862024-11-05T00:00:42.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5872024-11-05T00:00:42.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5882024-11-05T00:00:42.221ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5892024-11-05T00:00:42.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5902024-11-05T00:00:42.224ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5912024-11-05T00:00:42.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5922024-11-05T00:00:42.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5932024-11-05T00:00:42.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5942024-11-05T00:00:42.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5952024-11-05T00:00:42.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5962024-11-05T00:00:42.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5972024-11-05T00:00:42.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5982024-11-05T00:00:42.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5992024-11-05T00:00:42.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6002024-11-05T00:00:42.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6012024-11-05T00:00:42.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6022024-11-05T00:00:42.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6032024-11-05T00:00:42.240ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6042024-11-05T00:00:42.240ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6052024-11-05T00:00:42.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6062024-11-05T00:00:42.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6072024-11-05T00:00:42.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6082024-11-05T00:00:42.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6092024-11-05T00:00:42.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6102024-11-05T00:00:42.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6112024-11-05T00:00:42.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6122024-11-05T00:00:42.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6132024-11-05T00:00:42.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6142024-11-05T00:00:42.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6152024-11-05T00:00:42.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6162024-11-05T00:00:42.246ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6172024-11-05T00:00:42.246ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6182024-11-05T00:00:42.246ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.592862ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6192024-11-05T00:00:42.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6202024-11-05T00:00:42.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6212024-11-05T00:00:42.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 77.832637ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6222024-11-05T00:00:42.250ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6232024-11-05T00:00:42.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6242024-11-05T00:00:42.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6252024-11-05T00:00:42.252ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6262024-11-05T00:00:42.252ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6272024-11-05T00:00:42.252ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6282024-11-05T00:00:42.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6292024-11-05T00:00:42.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6302024-11-05T00:00:42.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6312024-11-05T00:00:42.253ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6322024-11-05T00:00:42.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6332024-11-05T00:00:42.257ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6342024-11-05T00:00:42.257ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.095617ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6352024-11-05T00:00:42.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6362024-11-05T00:00:42.266ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6372024-11-05T00:00:42.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6382024-11-05T00:00:42.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6392024-11-05T00:00:42.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6402024-11-05T00:00:42.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6412024-11-05T00:00:42.273ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6422024-11-05T00:00:42.273ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6432024-11-05T00:00:42.273ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.517514ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6442024-11-05T00:00:42.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6452024-11-05T00:00:42.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6462024-11-05T00:00:42.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
6472024-11-05T00:00:42.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6482024-11-05T00:00:42.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6492024-11-05T00:00:42.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6502024-11-05T00:00:42.278ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6512024-11-05T00:00:42.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6522024-11-05T00:00:42.297ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6532024-11-05T00:00:42.297ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6542024-11-05T00:00:42.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6552024-11-05T00:00:42.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6562024-11-05T00:00:42.318ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6572024-11-05T00:00:42.318ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6582024-11-05T00:00:42.318ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6592024-11-05T00:00:42.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6602024-11-05T00:00:42.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6612024-11-05T00:00:42.362ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
6622024-11-05T00:00:42.362ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6632024-11-05T00:00:42.362ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83a61bdd-d881-4cee-aafb-3cb0b0191b21", "content-length": "26", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
6642024-11-05T00:00:42.362ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6652024-11-05T00:00:42.365ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6662024-11-05T00:00:42.419ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
6672024-11-05T00:00:42.455ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6682024-11-05T00:00:42.482ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
6692024-11-05T00:00:42.483ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a52bce31-ca69-406b-87f9-23ef208044dd", "content-length": "691", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
6702024-11-05T00:00:42.483ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
6712024-11-05T00:00:42.483ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
6722024-11-05T00:00:42.483ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
6732024-11-05T00:00:42.486ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 316.471486ms iteration = 13 status = {}
6742024-11-05T00:00:42.542ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
6752024-11-05T00:00:42.542ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6762024-11-05T00:00:42.542ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1acee417-0c7c-4ddc-a482-1bc5abf03cb9", "content-length": "26", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
6772024-11-05T00:00:42.542ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6782024-11-05T00:00:42.549ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
6792024-11-05T00:00:42.557ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
6802024-11-05T00:00:42.557ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6812024-11-05T00:00:42.557ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e55d7d74-489b-4e74-b1ad-233ab87ed475", "content-length": "26", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
6822024-11-05T00:00:42.557ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6832024-11-05T00:00:42.559ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6842024-11-05T00:00:42.599ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6852024-11-05T00:00:42.599ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a110fae-b17e-435b-b539-fa4d85692fb7", "content-length": "1", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
6862024-11-05T00:00:42.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6872024-11-05T00:00:42.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6882024-11-05T00:00:42.612ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
6892024-11-05T00:00:42.612ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6902024-11-05T00:00:42.612ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f7e4793-14d2-4a80-af7d-4688e1294f19", "content-length": "372", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
6912024-11-05T00:00:42.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6922024-11-05T00:00:42.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6932024-11-05T00:00:42.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6942024-11-05T00:00:42.616ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 445.970464ms iteration = 4 status = {"nsuccess":5}
6952024-11-05T00:00:42.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6962024-11-05T00:00:42.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6972024-11-05T00:00:42.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6982024-11-05T00:00:42.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6992024-11-05T00:00:42.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7002024-11-05T00:00:42.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7012024-11-05T00:00:42.623ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 453.707033ms iteration = 13 status = null
7022024-11-05T00:00:42.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e5e3ceef-3dd3-44ba-bdc1-5c4cdbdcea91 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7032024-11-05T00:00:42.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e5e3ceef-3dd3-44ba-bdc1-5c4cdbdcea91 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7042024-11-05T00:00:42.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
7052024-11-05T00:00:42.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7062024-11-05T00:00:42.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7072024-11-05T00:00:42.630ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 459.962582ms iteration = 13 status = 0
7082024-11-05T00:00:42.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e5e3ceef-3dd3-44ba-bdc1-5c4cdbdcea91 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7092024-11-05T00:00:42.633ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
7102024-11-05T00:00:42.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 463.553285ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
7112024-11-05T00:00:42.633ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7122024-11-05T00:00:42.652ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7132024-11-05T00:00:42.652ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ade44715-d549-4a81-8c37-70d24980a5cf", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7142024-11-05T00:00:42.652ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7152024-11-05T00:00:42.654ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ba41973b-969b-4d22-a0f3-ea943a54b174", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7162024-11-05T00:00:42.654ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7172024-11-05T00:00:42.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 485.453405ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7182024-11-05T00:00:42.655ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7192024-11-05T00:00:42.655ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 485.550617ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7202024-11-05T00:00:42.661ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7212024-11-05T00:00:42.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7222024-11-05T00:00:42.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7232024-11-05T00:00:42.663ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7242024-11-05T00:00:42.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7252024-11-05T00:00:42.664ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7262024-11-05T00:00:42.664ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7272024-11-05T00:00:42.664ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 493.931609ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7282024-11-05T00:00:42.664ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7292024-11-05T00:00:42.664ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7302024-11-05T00:00:42.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7312024-11-05T00:00:42.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7322024-11-05T00:00:42.666ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 496.769627ms iteration = 15 status = {"physical_disks_added":0}
7332024-11-05T00:00:42.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7342024-11-05T00:00:42.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7352024-11-05T00:00:42.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7362024-11-05T00:00:42.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372024-11-05T00:00:42.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7382024-11-05T00:00:42.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7392024-11-05T00:00:42.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7402024-11-05T00:00:42.674ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7412024-11-05T00:00:42.674ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7422024-11-05T00:00:42.674ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-04 23:54:43.769339 UTC dns_group = internal generation = 1
7432024-11-05T00:00:42.674ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 504.983196ms iteration = 7 status = {"generation":1}
7442024-11-05T00:00:42.683ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 512.902528ms iteration = 13 status = {}
7452024-11-05T00:00:42.687ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
7462024-11-05T00:00:42.687ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
7472024-11-05T00:00:42.690ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7482024-11-05T00:00:42.690ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7492024-11-05T00:00:42.691ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "97857b9f-9c7a-451a-863e-134a202a69f0", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
7502024-11-05T00:00:42.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7512024-11-05T00:00:42.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7522024-11-05T00:00:42.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7532024-11-05T00:00:42.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7542024-11-05T00:00:42.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7552024-11-05T00:00:42.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7562024-11-05T00:00:42.699ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7572024-11-05T00:00:42.699ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 0 version = 2
7582024-11-05T00:00:42.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7592024-11-05T00:00:42.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7602024-11-05T00:00:42.700ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7612024-11-05T00:00:42.700ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7622024-11-05T00:00:42.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7632024-11-05T00:00:42.701ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cab54034-c32a-46fc-a5b2-e49aa1bb373f", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
7642024-11-05T00:00:42.702ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-04T23:54:39.943212Z, time_modified: 2024-11-04T23:54:39.943212Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }) }
7652024-11-05T00:00:42.702ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 532.501621ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]}},"default_endpoint":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7662024-11-05T00:00:42.703ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 533.028561ms iteration = 13 status = {}
7672024-11-05T00:00:42.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7682024-11-05T00:00:42.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7692024-11-05T00:00:42.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7702024-11-05T00:00:42.706ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 1 version = 2
7712024-11-05T00:00:42.706ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7722024-11-05T00:00:42.706ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-04 23:54:45.073528 UTC dns_group = external generation = 2
7732024-11-05T00:00:42.706ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 536.142975ms iteration = 7 status = {"generation":2}
7742024-11-05T00:00:42.714ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7752024-11-05T00:00:42.714ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 544.033728ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7762024-11-05T00:00:42.718ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7772024-11-05T00:00:42.718ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e17d3abf-42d3-4fd2-bb05-629fa78f4a4f", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7782024-11-05T00:00:42.718ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7792024-11-05T00:00:42.720ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bc1e07e8-f068-4bfa-91db-6d43205cc614", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7802024-11-05T00:00:42.720ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7812024-11-05T00:00:42.722ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b64d5bdd-0a6a-4123-b77c-3e5305212401", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7822024-11-05T00:00:42.722ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7832024-11-05T00:00:42.725ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7842024-11-05T00:00:42.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 555.203876ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7852024-11-05T00:00:42.766ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
7862024-11-05T00:00:42.766ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:42665
7872024-11-05T00:00:42.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42665 req_id = b84b3677-4bf3-46bb-a096-cb0764a6992a roles = RoleSet { roles: {} } uri = /metrics/producers
7882024-11-05T00:00:42.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42665 req_id = b84b3677-4bf3-46bb-a096-cb0764a6992a resource = Database result = Ok(()) uri = /metrics/producers
7892024-11-05T00:00:42.808ZINFOnexus: assigned collector to new producer collector_id = 936f0bc7-d5c8-4edc-b21c-cc06e01960a5 file = nexus/src/app/oximeter.rs:76 producer_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
7902024-11-05T00:00:42.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41574 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42665 req_id = b84b3677-4bf3-46bb-a096-cb0764a6992a response_code = 201 uri = /metrics/producers
7912024-11-05T00:00:42.808ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b84b3677-4bf3-46bb-a096-cb0764a6992a", "content-length": "41", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
7922024-11-05T00:00:42.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7932024-11-05T00:00:42.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7942024-11-05T00:00:42.809ZDEBGnexus (producer-registration-task): registered with nexus successfully
7952024-11-05T00:00:42.809ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
7962024-11-05T00:00:42.811ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
7972024-11-05T00:00:42.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7982024-11-05T00:00:42.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7992024-11-05T00:00:42.821ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8002024-11-05T00:00:42.821ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a1d9f01-9c1e-4ecf-88bc-d641a34d4ba8", "content-length": "134", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
8012024-11-05T00:00:42.821ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8022024-11-05T00:00:42.821ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
8032024-11-05T00:00:42.821ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8042024-11-05T00:00:42.821ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8052024-11-05T00:00:42.821ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8062024-11-05T00:00:42.821ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8072024-11-05T00:00:42.821ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8082024-11-05T00:00:42.821ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8092024-11-05T00:00:42.822ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8102024-11-05T00:00:42.822ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8112024-11-05T00:00:42.822ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
8122024-11-05T00:00:42.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8132024-11-05T00:00:42.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8142024-11-05T00:00:42.824ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8152024-11-05T00:00:42.824ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "447f3d5a-7fe8-471d-a15f-e5db2db5ac6e", "content-length": "2", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
8162024-11-05T00:00:42.824ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8172024-11-05T00:00:42.824ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9c1b2ee-eb93-460c-b554-d8fb6321a473", "content-length": "52", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
8182024-11-05T00:00:42.824ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
8192024-11-05T00:00:42.824ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8202024-11-05T00:00:43.031ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cec78eaa-7482-499d-b71b-898fe3eca1ed", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
8212024-11-05T00:00:43.031ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
8222024-11-05T00:00:43.031ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8232024-11-05T00:00:43.032ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "390498ef-9a53-4b92-b154-5b25d5229181", "content-length": "682", "date": "Tue, 05 Nov 2024 00:00:42 GMT"} })
8242024-11-05T00:00:43.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8252024-11-05T00:00:43.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8262024-11-05T00:00:43.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8272024-11-05T00:00:43.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8282024-11-05T00:00:43.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8292024-11-05T00:00:43.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8302024-11-05T00:00:43.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8312024-11-05T00:00:43.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8322024-11-05T00:00:43.049ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 879.413592ms iteration = 13 status = {}
8332024-11-05T00:00:43.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bc8260c4-d010-473c-8a3a-eab8648701cf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8342024-11-05T00:00:43.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bc8260c4-d010-473c-8a3a-eab8648701cf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8352024-11-05T00:00:43.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bc8260c4-d010-473c-8a3a-eab8648701cf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8362024-11-05T00:00:44.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a43d3f29-9747-4ac6-a640-457b0e940c26 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8372024-11-05T00:00:44.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a43d3f29-9747-4ac6-a640-457b0e940c26 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8382024-11-05T00:00:44.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a43d3f29-9747-4ac6-a640-457b0e940c26 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8392024-11-05T00:00:45.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d0c88ab7-3a5b-4051-a108-9a7ad3cb39ab roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8402024-11-05T00:00:45.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d0c88ab7-3a5b-4051-a108-9a7ad3cb39ab resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8412024-11-05T00:00:45.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d0c88ab7-3a5b-4051-a108-9a7ad3cb39ab response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8422024-11-05T00:00:46.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8bd483b4-cd36-41e5-8ea9-0bef55e9dc2d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8432024-11-05T00:00:46.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8bd483b4-cd36-41e5-8ea9-0bef55e9dc2d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8442024-11-05T00:00:46.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8bd483b4-cd36-41e5-8ea9-0bef55e9dc2d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8452024-11-05T00:00:47.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2bccf45e-70c4-41df-833e-7bb3891617af roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8462024-11-05T00:00:47.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2bccf45e-70c4-41df-833e-7bb3891617af resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8472024-11-05T00:00:47.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2bccf45e-70c4-41df-833e-7bb3891617af response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8482024-11-05T00:00:48.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fb34bcc7-b326-462f-9d0a-3dc162c3757a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8492024-11-05T00:00:48.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fb34bcc7-b326-462f-9d0a-3dc162c3757a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8502024-11-05T00:00:48.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fb34bcc7-b326-462f-9d0a-3dc162c3757a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8512024-11-05T00:00:49.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4b1ed003-80d2-4e17-8435-48de9f252d3e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8522024-11-05T00:00:49.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4b1ed003-80d2-4e17-8435-48de9f252d3e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8532024-11-05T00:00:49.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4b1ed003-80d2-4e17-8435-48de9f252d3e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8542024-11-05T00:00:50.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5f80b3ab-7880-4860-a9de-4a4bfee0f706 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8552024-11-05T00:00:50.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5f80b3ab-7880-4860-a9de-4a4bfee0f706 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8562024-11-05T00:00:50.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5f80b3ab-7880-4860-a9de-4a4bfee0f706 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8572024-11-05T00:00:51.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 82ef3871-a5ad-4c7d-a004-9a82617e913d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8582024-11-05T00:00:51.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 82ef3871-a5ad-4c7d-a004-9a82617e913d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8592024-11-05T00:00:51.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 82ef3871-a5ad-4c7d-a004-9a82617e913d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8602024-11-05T00:00:51.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 496 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 66eff9e8-b5cc-45d4-b85f-72b05feb1677 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
8612024-11-05T00:00:52.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
8622024-11-05T00:00:52.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
8632024-11-05T00:00:52.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8642024-11-05T00:00:52.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8652024-11-05T00:00:52.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8662024-11-05T00:00:52.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8672024-11-05T00:00:52.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8682024-11-05T00:00:52.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8692024-11-05T00:00:52.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8702024-11-05T00:00:52.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.271122ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8712024-11-05T00:00:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8722024-11-05T00:00:52.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8732024-11-05T00:00:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8742024-11-05T00:00:52.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8752024-11-05T00:00:52.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8762024-11-05T00:00:52.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8772024-11-05T00:00:52.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
8782024-11-05T00:00:52.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8792024-11-05T00:00:52.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8802024-11-05T00:00:52.218ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
8812024-11-05T00:00:52.218ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.461065ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
8822024-11-05T00:00:52.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2a003755-2879-45cf-b1b6-8e0a8f083733 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8832024-11-05T00:00:52.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2a003755-2879-45cf-b1b6-8e0a8f083733 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8842024-11-05T00:00:52.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2a003755-2879-45cf-b1b6-8e0a8f083733 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8852024-11-05T00:00:53.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 713d2e11-4e1c-4890-a1b4-db45ba22f3e0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8862024-11-05T00:00:53.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 713d2e11-4e1c-4890-a1b4-db45ba22f3e0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8872024-11-05T00:00:53.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 713d2e11-4e1c-4890-a1b4-db45ba22f3e0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8882024-11-05T00:00:54.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 40704295-d7e6-4503-9d4b-f551f48e68dc roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8892024-11-05T00:00:54.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 40704295-d7e6-4503-9d4b-f551f48e68dc resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8902024-11-05T00:00:54.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 40704295-d7e6-4503-9d4b-f551f48e68dc response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8912024-11-05T00:00:55.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3495ff61-3003-400c-a77b-871101301a99 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8922024-11-05T00:00:55.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3495ff61-3003-400c-a77b-871101301a99 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8932024-11-05T00:00:55.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3495ff61-3003-400c-a77b-871101301a99 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8942024-11-05T00:00:56.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f71b5c8b-3a38-4d66-9ede-eb4daf0c7172 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8952024-11-05T00:00:56.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f71b5c8b-3a38-4d66-9ede-eb4daf0c7172 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8962024-11-05T00:00:56.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f71b5c8b-3a38-4d66-9ede-eb4daf0c7172 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8972024-11-05T00:00:57.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ed8efd5a-ba93-469e-bd2d-098f73bb911c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8982024-11-05T00:00:57.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ed8efd5a-ba93-469e-bd2d-098f73bb911c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8992024-11-05T00:00:57.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ed8efd5a-ba93-469e-bd2d-098f73bb911c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9002024-11-05T00:00:58.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fb1e2f8-f102-4f09-8096-f04fc4e9fad1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9012024-11-05T00:00:58.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fb1e2f8-f102-4f09-8096-f04fc4e9fad1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9022024-11-05T00:00:58.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fb1e2f8-f102-4f09-8096-f04fc4e9fad1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9032024-11-05T00:01:00.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b788cd3b-3b0a-4997-a143-770b8cca7634 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9042024-11-05T00:01:00.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b788cd3b-3b0a-4997-a143-770b8cca7634 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9052024-11-05T00:01:00.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b788cd3b-3b0a-4997-a143-770b8cca7634 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9062024-11-05T00:01:01.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 13b1fb52-a6b0-4307-b736-28536be35a9c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9072024-11-05T00:01:01.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 13b1fb52-a6b0-4307-b736-28536be35a9c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9082024-11-05T00:01:01.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 13b1fb52-a6b0-4307-b736-28536be35a9c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9092024-11-05T00:01:02.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = eb388d1c-bdc2-4850-9552-ef7bef8a84ad roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9102024-11-05T00:01:02.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = eb388d1c-bdc2-4850-9552-ef7bef8a84ad resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9112024-11-05T00:01:02.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = eb388d1c-bdc2-4850-9552-ef7bef8a84ad response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9122024-11-05T00:01:02.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
9132024-11-05T00:01:02.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
9142024-11-05T00:01:02.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9152024-11-05T00:01:02.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9162024-11-05T00:01:02.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9172024-11-05T00:01:02.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9182024-11-05T00:01:02.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9192024-11-05T00:01:02.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9202024-11-05T00:01:02.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9212024-11-05T00:01:02.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.365419ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9222024-11-05T00:01:02.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9232024-11-05T00:01:02.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9242024-11-05T00:01:02.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9252024-11-05T00:01:02.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9262024-11-05T00:01:02.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9272024-11-05T00:01:02.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9282024-11-05T00:01:02.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
9292024-11-05T00:01:02.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9302024-11-05T00:01:02.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9312024-11-05T00:01:02.192ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
9322024-11-05T00:01:02.192ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.40918ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
9332024-11-05T00:01:03.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07c59aaa-817f-41dd-824a-d2ac45c47ca4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9342024-11-05T00:01:03.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07c59aaa-817f-41dd-824a-d2ac45c47ca4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9352024-11-05T00:01:03.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07c59aaa-817f-41dd-824a-d2ac45c47ca4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9362024-11-05T00:01:04.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5856d1a3-0152-4aff-b715-b3adca3c9914 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9372024-11-05T00:01:04.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5856d1a3-0152-4aff-b715-b3adca3c9914 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9382024-11-05T00:01:04.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5856d1a3-0152-4aff-b715-b3adca3c9914 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9392024-11-05T00:01:05.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2c67ac84-3822-4ec8-8394-71bd4871fef7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9402024-11-05T00:01:05.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2c67ac84-3822-4ec8-8394-71bd4871fef7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9412024-11-05T00:01:05.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2c67ac84-3822-4ec8-8394-71bd4871fef7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9422024-11-05T00:01:06.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2472c0d0-d8ee-4f43-865a-9cb532f2d420 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9432024-11-05T00:01:06.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2472c0d0-d8ee-4f43-865a-9cb532f2d420 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9442024-11-05T00:01:06.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2472c0d0-d8ee-4f43-865a-9cb532f2d420 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9452024-11-05T00:01:06.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 522 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = dc808add-fc17-4ff0-b49e-cd3e158a528b response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
9462024-11-05T00:01:07.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8ec9a468-0ffc-4dbb-9d53-93d9c954c26e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9472024-11-05T00:01:07.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8ec9a468-0ffc-4dbb-9d53-93d9c954c26e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9482024-11-05T00:01:07.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8ec9a468-0ffc-4dbb-9d53-93d9c954c26e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9492024-11-05T00:01:08.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07b152c6-1c92-4a18-bff2-54ddc019f9f1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9502024-11-05T00:01:08.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07b152c6-1c92-4a18-bff2-54ddc019f9f1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9512024-11-05T00:01:08.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07b152c6-1c92-4a18-bff2-54ddc019f9f1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9522024-11-05T00:01:09.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5b68015c-94a7-41b2-8a60-15f9859151f3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9532024-11-05T00:01:09.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5b68015c-94a7-41b2-8a60-15f9859151f3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9542024-11-05T00:01:09.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5b68015c-94a7-41b2-8a60-15f9859151f3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9552024-11-05T00:01:10.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0249fefb-8a7b-45c2-bb83-79e4bf8c6e3f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9562024-11-05T00:01:10.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0249fefb-8a7b-45c2-bb83-79e4bf8c6e3f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9572024-11-05T00:01:10.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0249fefb-8a7b-45c2-bb83-79e4bf8c6e3f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9582024-11-05T00:01:11.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 023cad25-1da7-4a98-b4f7-55478d3526b1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9592024-11-05T00:01:11.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 023cad25-1da7-4a98-b4f7-55478d3526b1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9602024-11-05T00:01:11.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 023cad25-1da7-4a98-b4f7-55478d3526b1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9612024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
9622024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9632024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
9642024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
9652024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9662024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
9672024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9682024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
9692024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
9702024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9712024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9722024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
9732024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9742024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
9752024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9762024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
9772024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9782024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9792024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
9802024-11-05T00:01:12.170ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9812024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
9822024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9832024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9842024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
9852024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9862024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
9872024-11-05T00:01:12.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9882024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9892024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9902024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9912024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9922024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9932024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9942024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9952024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9962024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9972024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9982024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9992024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10002024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
10012024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
10022024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.47\u{b5}s iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
10032024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
10042024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
10052024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.731\u{b5}s iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10062024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.3\u{b5}s iteration = 14 status = {"errors":[],"records_set_to_done":[]}
10072024-11-05T00:01:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.121\u{b5}s iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10082024-11-05T00:01:12.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10092024-11-05T00:01:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.465101ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10102024-11-05T00:01:12.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10112024-11-05T00:01:12.175ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10122024-11-05T00:01:12.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10132024-11-05T00:01:12.175ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2715, tv_nsec: 763593150 } })
10142024-11-05T00:01:12.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10152024-11-05T00:01:12.175ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
10162024-11-05T00:01:12.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10172024-11-05T00:01:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10182024-11-05T00:01:12.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10192024-11-05T00:01:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10202024-11-05T00:01:12.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10212024-11-05T00:01:12.178ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10222024-11-05T00:01:12.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10232024-11-05T00:01:12.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10242024-11-05T00:01:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10252024-11-05T00:01:12.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10262024-11-05T00:01:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10272024-11-05T00:01:12.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10282024-11-05T00:01:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10292024-11-05T00:01:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10302024-11-05T00:01:12.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10312024-11-05T00:01:12.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10322024-11-05T00:01:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10332024-11-05T00:01:12.182ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2715, tv_nsec: 770338869 } })
10342024-11-05T00:01:12.182ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
10352024-11-05T00:01:12.182ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.299062ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10362024-11-05T00:01:12.182ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10372024-11-05T00:01:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10382024-11-05T00:01:12.183ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2715, tv_nsec: 771577304 } })
10392024-11-05T00:01:12.183ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
10402024-11-05T00:01:12.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10412024-11-05T00:01:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10422024-11-05T00:01:12.184ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10432024-11-05T00:01:12.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10442024-11-05T00:01:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10452024-11-05T00:01:12.187ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10462024-11-05T00:01:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10472024-11-05T00:01:12.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
10482024-11-05T00:01:12.188ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10492024-11-05T00:01:12.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10502024-11-05T00:01:12.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10512024-11-05T00:01:12.205ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
10522024-11-05T00:01:12.205ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.58936ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
10532024-11-05T00:01:12.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10542024-11-05T00:01:12.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10552024-11-05T00:01:12.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10562024-11-05T00:01:12.209ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10572024-11-05T00:01:12.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10582024-11-05T00:01:12.210ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10592024-11-05T00:01:12.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10602024-11-05T00:01:12.217ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10612024-11-05T00:01:12.217ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10622024-11-05T00:01:12.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10632024-11-05T00:01:12.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10642024-11-05T00:01:12.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10652024-11-05T00:01:12.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10662024-11-05T00:01:12.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10672024-11-05T00:01:12.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10682024-11-05T00:01:12.228ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10692024-11-05T00:01:12.228ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.653344ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10702024-11-05T00:01:12.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10712024-11-05T00:01:12.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10722024-11-05T00:01:12.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10732024-11-05T00:01:12.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10742024-11-05T00:01:12.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.075339ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10752024-11-05T00:01:12.257ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
10762024-11-05T00:01:12.257ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10772024-11-05T00:01:12.258ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4118001-47ab-4c14-b70b-25a36241446f", "content-length": "26", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
10782024-11-05T00:01:12.258ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10792024-11-05T00:01:12.260ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10802024-11-05T00:01:12.262ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10812024-11-05T00:01:12.262ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10822024-11-05T00:01:12.262ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10832024-11-05T00:01:12.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10842024-11-05T00:01:12.276ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
10852024-11-05T00:01:12.276ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10862024-11-05T00:01:12.277ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b396712d-dd44-42fc-baf6-5a33d4955dd0", "content-length": "26", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
10872024-11-05T00:01:12.277ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10882024-11-05T00:01:12.278ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10892024-11-05T00:01:12.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e7dcf24f-f17e-4ced-aec7-89fce6dec068 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
10902024-11-05T00:01:12.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e7dcf24f-f17e-4ced-aec7-89fce6dec068 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
10912024-11-05T00:01:12.299ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
10922024-11-05T00:01:12.299ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10932024-11-05T00:01:12.299ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ff38440-877c-4fe5-88d9-ee40fcced6e1", "content-length": "26", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
10942024-11-05T00:01:12.299ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10952024-11-05T00:01:12.302ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
10962024-11-05T00:01:12.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10972024-11-05T00:01:12.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10982024-11-05T00:01:12.310ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 140.188328ms iteration = 16 status = {"physical_disks_added":0}
10992024-11-05T00:01:12.406ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11002024-11-05T00:01:12.406ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6861c170-cf51-4a74-bad0-b31cb7a2e995", "content-length": "1", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
11012024-11-05T00:01:12.407ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11022024-11-05T00:01:12.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11032024-11-05T00:01:12.416ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11042024-11-05T00:01:12.416ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11052024-11-05T00:01:12.416ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "24d5cf03-5138-487e-85c6-1f1b918366ca", "content-length": "372", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
11062024-11-05T00:01:12.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11072024-11-05T00:01:12.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11082024-11-05T00:01:12.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e7dcf24f-f17e-4ced-aec7-89fce6dec068 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11092024-11-05T00:01:12.420ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 249.505671ms iteration = 14 status = null
11102024-11-05T00:01:12.444ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 273.724468ms iteration = 14 status = {}
11112024-11-05T00:01:12.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11122024-11-05T00:01:12.466ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11132024-11-05T00:01:12.466ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11142024-11-05T00:01:12.466ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 296.337203ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11152024-11-05T00:01:12.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
11162024-11-05T00:01:12.467ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11172024-11-05T00:01:12.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11182024-11-05T00:01:12.469ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 299.258533ms iteration = 14 status = 0
11192024-11-05T00:01:12.486ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
11202024-11-05T00:01:12.486ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11212024-11-05T00:01:12.486ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bf30bf79-7bc3-4baf-bfef-fde1991664d0", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
11222024-11-05T00:01:12.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11232024-11-05T00:01:12.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11242024-11-05T00:01:12.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11252024-11-05T00:01:12.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11262024-11-05T00:01:12.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11272024-11-05T00:01:12.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11282024-11-05T00:01:12.500ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11292024-11-05T00:01:12.500ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11302024-11-05T00:01:12.500ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ff8232a4-a139-4ad0-9d5f-2aa3814af754", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
11312024-11-05T00:01:12.503ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 333.058366ms iteration = 14 status = {}
11322024-11-05T00:01:12.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11332024-11-05T00:01:12.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11342024-11-05T00:01:12.518ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
11352024-11-05T00:01:12.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11362024-11-05T00:01:12.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11372024-11-05T00:01:12.529ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11382024-11-05T00:01:12.529ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "67537b0e-ce02-4a3f-85f6-456da4850d4f", "content-length": "134", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
11392024-11-05T00:01:12.529ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11402024-11-05T00:01:12.529ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
11412024-11-05T00:01:12.529ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11422024-11-05T00:01:12.529ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11432024-11-05T00:01:12.529ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11442024-11-05T00:01:12.529ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11452024-11-05T00:01:12.529ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11462024-11-05T00:01:12.529ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11472024-11-05T00:01:12.529ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11482024-11-05T00:01:12.530ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11492024-11-05T00:01:12.530ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
11502024-11-05T00:01:12.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11512024-11-05T00:01:12.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11522024-11-05T00:01:12.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11532024-11-05T00:01:12.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11542024-11-05T00:01:12.541ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11552024-11-05T00:01:12.541ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bdf53a1-ef19-485e-8bfb-9c539c4ff8f8", "content-length": "2", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
11562024-11-05T00:01:12.541ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11572024-11-05T00:01:12.541ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4912d4a3-02e6-423f-8eaa-b6ca7fbecad2", "content-length": "52", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
11582024-11-05T00:01:12.541ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
11592024-11-05T00:01:12.541ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11602024-11-05T00:01:12.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11612024-11-05T00:01:12.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11622024-11-05T00:01:12.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11632024-11-05T00:01:12.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11642024-11-05T00:01:12.546ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652024-11-05T00:01:12.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11662024-11-05T00:01:12.550ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11672024-11-05T00:01:12.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11682024-11-05T00:01:12.589ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11692024-11-05T00:01:12.670ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "08687988-2e45-4dc1-bc71-2e46b7705c6b", "content-length": "691", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
11702024-11-05T00:01:12.670ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11712024-11-05T00:01:12.670ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11722024-11-05T00:01:12.670ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11732024-11-05T00:01:12.673ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 502.979465ms iteration = 14 status = {}
11742024-11-05T00:01:12.818ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d479b42d-22d5-4725-b752-0cfea84f5f39", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
11752024-11-05T00:01:12.818ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
11762024-11-05T00:01:12.818ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11772024-11-05T00:01:12.823ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8eeafefe-c399-4ace-b328-690118ad4eba", "content-length": "682", "date": "Tue, 05 Nov 2024 00:01:12 GMT"} })
11782024-11-05T00:01:12.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11792024-11-05T00:01:12.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11802024-11-05T00:01:12.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11812024-11-05T00:01:12.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11822024-11-05T00:01:12.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11832024-11-05T00:01:12.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11842024-11-05T00:01:12.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11852024-11-05T00:01:12.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11862024-11-05T00:01:12.845ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 674.944795ms iteration = 14 status = {}
11872024-11-05T00:01:13.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 80f94dbc-f874-44fe-86b0-44bde973428d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11882024-11-05T00:01:13.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 80f94dbc-f874-44fe-86b0-44bde973428d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11892024-11-05T00:01:13.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 80f94dbc-f874-44fe-86b0-44bde973428d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11902024-11-05T00:01:14.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f6d17d82-cee4-476e-a2ae-ffb83e793b9d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11912024-11-05T00:01:14.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f6d17d82-cee4-476e-a2ae-ffb83e793b9d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11922024-11-05T00:01:14.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f6d17d82-cee4-476e-a2ae-ffb83e793b9d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11932024-11-05T00:01:15.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c7e5a248-5e39-43c6-bd2f-a5fc20aeaea1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11942024-11-05T00:01:15.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c7e5a248-5e39-43c6-bd2f-a5fc20aeaea1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11952024-11-05T00:01:15.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c7e5a248-5e39-43c6-bd2f-a5fc20aeaea1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11962024-11-05T00:01:16.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cc31b0ca-1ed3-48ea-b434-1170eeee38ea roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11972024-11-05T00:01:16.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cc31b0ca-1ed3-48ea-b434-1170eeee38ea resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11982024-11-05T00:01:16.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cc31b0ca-1ed3-48ea-b434-1170eeee38ea response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
11992024-11-05T00:01:17.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c68ab58f-18ee-4b2b-9836-02b086905067 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12002024-11-05T00:01:17.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c68ab58f-18ee-4b2b-9836-02b086905067 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12012024-11-05T00:01:17.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c68ab58f-18ee-4b2b-9836-02b086905067 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12022024-11-05T00:01:18.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d9f3e56a-3760-4d5a-bc90-75deb7b4af9d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12032024-11-05T00:01:18.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d9f3e56a-3760-4d5a-bc90-75deb7b4af9d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12042024-11-05T00:01:18.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d9f3e56a-3760-4d5a-bc90-75deb7b4af9d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12052024-11-05T00:01:19.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 868a4f28-3be0-4f13-8fc2-07499aa48f2d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12062024-11-05T00:01:19.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 868a4f28-3be0-4f13-8fc2-07499aa48f2d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12072024-11-05T00:01:19.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 868a4f28-3be0-4f13-8fc2-07499aa48f2d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12082024-11-05T00:01:20.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fcb30e0b-9503-490d-83d6-b90ba7a137ba roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12092024-11-05T00:01:20.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fcb30e0b-9503-490d-83d6-b90ba7a137ba resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12102024-11-05T00:01:20.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fcb30e0b-9503-490d-83d6-b90ba7a137ba response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12112024-11-05T00:01:21.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ba5691c6-765e-4719-b90e-16943d1e9fe0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12122024-11-05T00:01:21.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ba5691c6-765e-4719-b90e-16943d1e9fe0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12132024-11-05T00:01:21.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ba5691c6-765e-4719-b90e-16943d1e9fe0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12142024-11-05T00:01:21.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 768 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 59808f8b-3530-4f30-a09e-f49961fe7923 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
12152024-11-05T00:01:22.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
12162024-11-05T00:01:22.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
12172024-11-05T00:01:22.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12182024-11-05T00:01:22.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12192024-11-05T00:01:22.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12202024-11-05T00:01:22.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12212024-11-05T00:01:22.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12222024-11-05T00:01:22.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12232024-11-05T00:01:22.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12242024-11-05T00:01:22.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12252024-11-05T00:01:22.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12262024-11-05T00:01:22.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12272024-11-05T00:01:22.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12282024-11-05T00:01:22.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
12292024-11-05T00:01:22.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12302024-11-05T00:01:22.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12312024-11-05T00:01:22.192ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
12322024-11-05T00:01:22.192ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.214185ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
12332024-11-05T00:01:22.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12342024-11-05T00:01:22.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12352024-11-05T00:01:22.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.277029ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12362024-11-05T00:01:22.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9299683f-090b-4617-a4b2-896203ad2c2d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12372024-11-05T00:01:22.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9299683f-090b-4617-a4b2-896203ad2c2d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12382024-11-05T00:01:22.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9299683f-090b-4617-a4b2-896203ad2c2d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12392024-11-05T00:01:23.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 17cb0d80-b390-4b92-9054-02a988437557 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12402024-11-05T00:01:23.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 17cb0d80-b390-4b92-9054-02a988437557 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12412024-11-05T00:01:23.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 17cb0d80-b390-4b92-9054-02a988437557 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12422024-11-05T00:01:24.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a50f93be-e0bb-493d-b6eb-7a9c1e5a3553 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12432024-11-05T00:01:24.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a50f93be-e0bb-493d-b6eb-7a9c1e5a3553 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12442024-11-05T00:01:24.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a50f93be-e0bb-493d-b6eb-7a9c1e5a3553 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12452024-11-05T00:01:25.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 06c83cb7-cf63-41b3-a690-f4632a07e1e3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12462024-11-05T00:01:25.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 06c83cb7-cf63-41b3-a690-f4632a07e1e3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12472024-11-05T00:01:25.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 06c83cb7-cf63-41b3-a690-f4632a07e1e3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12482024-11-05T00:01:26.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5e11dc9a-63e8-48b0-ba79-0675904dbdf9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12492024-11-05T00:01:26.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5e11dc9a-63e8-48b0-ba79-0675904dbdf9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12502024-11-05T00:01:26.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5e11dc9a-63e8-48b0-ba79-0675904dbdf9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12512024-11-05T00:01:27.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e27f904a-7542-4f03-906d-2f587a84fd5d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12522024-11-05T00:01:27.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e27f904a-7542-4f03-906d-2f587a84fd5d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12532024-11-05T00:01:27.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e27f904a-7542-4f03-906d-2f587a84fd5d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12542024-11-05T00:01:28.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 85a9a135-79d5-4934-9a79-87be34901374 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12552024-11-05T00:01:28.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 85a9a135-79d5-4934-9a79-87be34901374 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12562024-11-05T00:01:28.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 85a9a135-79d5-4934-9a79-87be34901374 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12572024-11-05T00:01:29.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6d7ad7db-6077-4152-8085-7ffedee9bc49 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12582024-11-05T00:01:29.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6d7ad7db-6077-4152-8085-7ffedee9bc49 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12592024-11-05T00:01:29.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6d7ad7db-6077-4152-8085-7ffedee9bc49 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12602024-11-05T00:01:30.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 14a0fb3d-b5e4-482d-9dfc-808d04c8deb9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12612024-11-05T00:01:30.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 14a0fb3d-b5e4-482d-9dfc-808d04c8deb9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12622024-11-05T00:01:30.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 14a0fb3d-b5e4-482d-9dfc-808d04c8deb9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12632024-11-05T00:01:31.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3b592142-acf6-474a-90e4-6ef3d326de13 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12642024-11-05T00:01:31.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3b592142-acf6-474a-90e4-6ef3d326de13 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12652024-11-05T00:01:31.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3b592142-acf6-474a-90e4-6ef3d326de13 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12662024-11-05T00:01:32.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
12672024-11-05T00:01:32.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12682024-11-05T00:01:32.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
12692024-11-05T00:01:32.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12702024-11-05T00:01:32.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12712024-11-05T00:01:32.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12722024-11-05T00:01:32.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12732024-11-05T00:01:32.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12742024-11-05T00:01:32.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12752024-11-05T00:01:32.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12762024-11-05T00:01:32.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12772024-11-05T00:01:32.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12782024-11-05T00:01:32.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12792024-11-05T00:01:32.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12802024-11-05T00:01:32.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12812024-11-05T00:01:32.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
12822024-11-05T00:01:32.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12832024-11-05T00:01:32.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12842024-11-05T00:01:32.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
12852024-11-05T00:01:32.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.326188ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
12862024-11-05T00:01:32.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.760644ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12872024-11-05T00:01:32.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 80feeb19-4e68-4e3c-bbda-8b720caf66dd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12882024-11-05T00:01:32.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 80feeb19-4e68-4e3c-bbda-8b720caf66dd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12892024-11-05T00:01:32.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 80feeb19-4e68-4e3c-bbda-8b720caf66dd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12902024-11-05T00:01:33.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9b7b81b5-855d-4d15-9465-566da0107e00 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12912024-11-05T00:01:33.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9b7b81b5-855d-4d15-9465-566da0107e00 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12922024-11-05T00:01:33.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9b7b81b5-855d-4d15-9465-566da0107e00 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12932024-11-05T00:01:34.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c7db8bc1-9366-4754-82c4-3a6de82849c8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12942024-11-05T00:01:34.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c7db8bc1-9366-4754-82c4-3a6de82849c8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12952024-11-05T00:01:34.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c7db8bc1-9366-4754-82c4-3a6de82849c8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12962024-11-05T00:01:35.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7873d7c9-5fef-4339-804a-c8aaec225e5d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12972024-11-05T00:01:35.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7873d7c9-5fef-4339-804a-c8aaec225e5d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12982024-11-05T00:01:35.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7873d7c9-5fef-4339-804a-c8aaec225e5d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
12992024-11-05T00:01:36.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 754 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = e701c6cd-3654-4ae1-bd2d-deafa943dea1 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
13002024-11-05T00:01:36.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 09f62db3-ab20-4e77-ad4d-6e82c1c90bcf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13012024-11-05T00:01:36.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 09f62db3-ab20-4e77-ad4d-6e82c1c90bcf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13022024-11-05T00:01:36.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 09f62db3-ab20-4e77-ad4d-6e82c1c90bcf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13032024-11-05T00:01:37.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 02881541-c748-48ec-ac0b-01b8a0a694e6 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13042024-11-05T00:01:37.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 02881541-c748-48ec-ac0b-01b8a0a694e6 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13052024-11-05T00:01:37.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 02881541-c748-48ec-ac0b-01b8a0a694e6 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13062024-11-05T00:01:39.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1d0460b0-54e4-4218-9236-68b9b59c4068 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13072024-11-05T00:01:39.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1d0460b0-54e4-4218-9236-68b9b59c4068 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13082024-11-05T00:01:39.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1d0460b0-54e4-4218-9236-68b9b59c4068 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13092024-11-05T00:01:40.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 04ec5844-bcc8-479c-844d-480bc3c7237b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13102024-11-05T00:01:40.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 04ec5844-bcc8-479c-844d-480bc3c7237b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13112024-11-05T00:01:40.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 04ec5844-bcc8-479c-844d-480bc3c7237b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13122024-11-05T00:01:41.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ae5cdad6-d4f7-4714-a457-e92ab8b9a068 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13132024-11-05T00:01:41.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ae5cdad6-d4f7-4714-a457-e92ab8b9a068 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13142024-11-05T00:01:41.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ae5cdad6-d4f7-4714-a457-e92ab8b9a068 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13152024-11-05T00:01:41.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = a8c40689-6eec-4d44-b442-edc1498863ee roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
13162024-11-05T00:01:41.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = a8c40689-6eec-4d44-b442-edc1498863ee resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
13172024-11-05T00:01:41.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = a8c40689-6eec-4d44-b442-edc1498863ee response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
13182024-11-05T00:01:41.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 5e83038b-8900-466e-9065-b8d915274ff8 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
13192024-11-05T00:01:41.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 5e83038b-8900-466e-9065-b8d915274ff8 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
13202024-11-05T00:01:41.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 5e83038b-8900-466e-9065-b8d915274ff8 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
13212024-11-05T00:01:42.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 170dd196-4521-49c6-9faf-42f9f8d16fac roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13222024-11-05T00:01:42.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 170dd196-4521-49c6-9faf-42f9f8d16fac resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13232024-11-05T00:01:42.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 170dd196-4521-49c6-9faf-42f9f8d16fac response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13242024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
13252024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
13262024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13272024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13282024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
13292024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13302024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
13312024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
13322024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
13332024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
13342024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13352024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
13362024-11-05T00:01:42.170ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-04 23:51:42.170895427 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13372024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13382024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13392024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13402024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
13412024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
13422024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13432024-11-05T00:01:42.170ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
13442024-11-05T00:01:42.171ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13452024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
13462024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13472024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13482024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
13492024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13502024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
13512024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13522024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
13532024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
13542024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13552024-11-05T00:01:42.171ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13562024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13572024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
13582024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13592024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
13602024-11-05T00:01:42.171ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970
13612024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
13622024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.57\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970"}
13632024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
13642024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13652024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
13662024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
13672024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13682024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13692024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
13702024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13712024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13722024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
13732024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13742024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
13752024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13762024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.81\u{b5}s iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
13772024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
13782024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
13792024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
13802024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13812024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.43\u{b5}s iteration = 15 status = {"errors":[],"records_set_to_done":[]}
13822024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.67\u{b5}s iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13832024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
13842024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.64\u{b5}s iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13852024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
13862024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13872024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13882024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
13892024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13902024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13912024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13922024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13932024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13942024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13952024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13962024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13972024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13982024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13992024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14002024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14012024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14022024-11-05T00:01:42.171ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("08f058bf-bffa-4561-8799-2d5d32641d33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e5a3f00-3f5b-4cac-8aa4-99515a0afee2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2745, tv_nsec: 759566027 } })
14032024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14042024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14052024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14062024-11-05T00:01:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14072024-11-05T00:01:42.171ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f4c9dd5-dad6-4fc2-ba58-b064adbea295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2745, tv_nsec: 759720911 } })
14082024-11-05T00:01:42.172ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
14092024-11-05T00:01:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.295707ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
14102024-11-05T00:01:42.172ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
14112024-11-05T00:01:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.143793ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
14122024-11-05T00:01:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14132024-11-05T00:01:42.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14142024-11-05T00:01:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14152024-11-05T00:01:42.173ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2745, tv_nsec: 761784353 } })
14162024-11-05T00:01:42.174ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
14172024-11-05T00:01:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.757687ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14182024-11-05T00:01:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14192024-11-05T00:01:42.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14202024-11-05T00:01:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14212024-11-05T00:01:42.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14222024-11-05T00:01:42.177ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2745, tv_nsec: 765598601 } })
14232024-11-05T00:01:42.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
14242024-11-05T00:01:42.178ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14252024-11-05T00:01:42.178ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-04 23:51:42.170895427 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14262024-11-05T00:01:42.178ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.712248ms iteration = 8 status = {"expiration":"2024-11-04T23:51:42.170895427Z","pruned":[]}
14272024-11-05T00:01:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14282024-11-05T00:01:42.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14292024-11-05T00:01:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14302024-11-05T00:01:42.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14312024-11-05T00:01:42.180ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14322024-11-05T00:01:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14332024-11-05T00:01:42.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14342024-11-05T00:01:42.181ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14352024-11-05T00:01:42.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14362024-11-05T00:01:42.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14372024-11-05T00:01:42.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14382024-11-05T00:01:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14392024-11-05T00:01:42.184ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14402024-11-05T00:01:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14412024-11-05T00:01:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14422024-11-05T00:01:42.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14432024-11-05T00:01:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14442024-11-05T00:01:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14452024-11-05T00:01:42.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14462024-11-05T00:01:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14472024-11-05T00:01:42.187ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.245014ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
14482024-11-05T00:01:42.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14492024-11-05T00:01:42.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14502024-11-05T00:01:42.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14512024-11-05T00:01:42.191ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14522024-11-05T00:01:42.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14532024-11-05T00:01:42.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14542024-11-05T00:01:42.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14552024-11-05T00:01:42.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14562024-11-05T00:01:42.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14572024-11-05T00:01:42.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14582024-11-05T00:01:42.208ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14592024-11-05T00:01:42.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14602024-11-05T00:01:42.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14612024-11-05T00:01:42.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14622024-11-05T00:01:42.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14632024-11-05T00:01:42.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14642024-11-05T00:01:42.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14652024-11-05T00:01:42.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14662024-11-05T00:01:42.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14672024-11-05T00:01:42.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14682024-11-05T00:01:42.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14692024-11-05T00:01:42.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14702024-11-05T00:01:42.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14712024-11-05T00:01:42.244ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14722024-11-05T00:01:42.244ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14732024-11-05T00:01:42.244ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.016109ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14742024-11-05T00:01:42.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14752024-11-05T00:01:42.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14762024-11-05T00:01:42.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14772024-11-05T00:01:42.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14782024-11-05T00:01:42.251ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14792024-11-05T00:01:42.251ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14802024-11-05T00:01:42.251ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14812024-11-05T00:01:42.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14822024-11-05T00:01:42.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14832024-11-05T00:01:42.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14842024-11-05T00:01:42.252ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14852024-11-05T00:01:42.252ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14862024-11-05T00:01:42.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14872024-11-05T00:01:42.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
14882024-11-05T00:01:42.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14892024-11-05T00:01:42.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14902024-11-05T00:01:42.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14912024-11-05T00:01:42.253ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14922024-11-05T00:01:42.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14932024-11-05T00:01:42.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14942024-11-05T00:01:42.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14952024-11-05T00:01:42.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14962024-11-05T00:01:42.257ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
14972024-11-05T00:01:42.257ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
14982024-11-05T00:01:42.257ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 86.878253ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
14992024-11-05T00:01:42.259ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15002024-11-05T00:01:42.259ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.320453ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15012024-11-05T00:01:42.278ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15022024-11-05T00:01:42.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15032024-11-05T00:01:42.298ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15042024-11-05T00:01:42.298ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15052024-11-05T00:01:42.298ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15062024-11-05T00:01:42.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15072024-11-05T00:01:42.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15082024-11-05T00:01:42.320ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15092024-11-05T00:01:42.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15102024-11-05T00:01:42.333ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15112024-11-05T00:01:42.342ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
15122024-11-05T00:01:42.342ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15132024-11-05T00:01:42.343ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f92545b-bbc4-4662-a8ff-65c536d4637f", "content-length": "26", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} })
15142024-11-05T00:01:42.343ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15152024-11-05T00:01:42.344ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15162024-11-05T00:01:42.345ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
15172024-11-05T00:01:42.345ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15182024-11-05T00:01:42.345ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d9a1823-5cf3-4ade-a2ec-7f3f34989a04", "content-length": "26", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} })
15192024-11-05T00:01:42.345ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15202024-11-05T00:01:42.347ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15212024-11-05T00:01:42.366ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15222024-11-05T00:01:42.498ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15232024-11-05T00:01:42.504ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.900794ms iteration = 15 status = {}
15242024-11-05T00:01:42.505ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15252024-11-05T00:01:42.505ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15262024-11-05T00:01:42.505ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f656797e-f90c-47bd-ac77-e61ac2b881f2", "content-length": "372", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} })
15272024-11-05T00:01:42.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15282024-11-05T00:01:42.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15292024-11-05T00:01:42.514ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2746, tv_nsec: 102624899 } })
15302024-11-05T00:01:42.515ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
15312024-11-05T00:01:42.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15322024-11-05T00:01:42.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15332024-11-05T00:01:42.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15342024-11-05T00:01:42.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15352024-11-05T00:01:42.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15362024-11-05T00:01:42.522ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15372024-11-05T00:01:42.522ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a206abd-9821-473b-9328-d4c652205797", "content-length": "1", "date": "Tue, 05 Nov 2024 00:01:41 GMT"} })
15382024-11-05T00:01:42.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15392024-11-05T00:01:42.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15402024-11-05T00:01:42.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15412024-11-05T00:01:42.525ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15422024-11-05T00:01:42.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15432024-11-05T00:01:42.528ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 357.740783ms iteration = 15 status = null
15442024-11-05T00:01:42.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
15452024-11-05T00:01:42.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 359.923818ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
15462024-11-05T00:01:42.572ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15472024-11-05T00:01:42.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15482024-11-05T00:01:42.573ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15492024-11-05T00:01:42.573ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "dc4157c6-5600-4ee6-aae3-79ae50a59072", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15502024-11-05T00:01:42.573ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15512024-11-05T00:01:42.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15522024-11-05T00:01:42.574ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15532024-11-05T00:01:42.574ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15542024-11-05T00:01:42.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15552024-11-05T00:01:42.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15562024-11-05T00:01:42.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15572024-11-05T00:01:42.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15582024-11-05T00:01:42.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15592024-11-05T00:01:42.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15602024-11-05T00:01:42.576ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7f384ce2-382f-4ae1-8078-f225a0a80cbf", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15612024-11-05T00:01:42.576ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15622024-11-05T00:01:42.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 406.064746ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15632024-11-05T00:01:42.579ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15642024-11-05T00:01:42.579ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 408.442515ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
15652024-11-05T00:01:42.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15662024-11-05T00:01:42.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15672024-11-05T00:01:42.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15682024-11-05T00:01:42.582ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15692024-11-05T00:01:42.582ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15702024-11-05T00:01:42.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15712024-11-05T00:01:42.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15722024-11-05T00:01:42.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15732024-11-05T00:01:42.584ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 413.853236ms iteration = 17 status = {"physical_disks_added":0}
15742024-11-05T00:01:42.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15752024-11-05T00:01:42.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15762024-11-05T00:01:42.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15772024-11-05T00:01:42.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 417.099542ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15782024-11-05T00:01:42.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792024-11-05T00:01:42.590ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
15802024-11-05T00:01:42.590ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15812024-11-05T00:01:42.590ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-04 23:54:43.769339 UTC dns_group = internal generation = 1
15822024-11-05T00:01:42.590ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 419.516201ms iteration = 8 status = {"generation":1}
15832024-11-05T00:01:42.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
15842024-11-05T00:01:42.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15852024-11-05T00:01:42.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15862024-11-05T00:01:42.593ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 421.923831ms iteration = 15 status = 0
15872024-11-05T00:01:42.594ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
15882024-11-05T00:01:42.594ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15892024-11-05T00:01:42.595ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5d1d416-6cfe-4dd9-96d5-bc3b283e8e6e", "content-length": "26", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} })
15902024-11-05T00:01:42.595ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15912024-11-05T00:01:42.596ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
15922024-11-05T00:01:42.599ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
15932024-11-05T00:01:42.600ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "49112b9c-2310-4168-b184-3cd5f61c1029", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15942024-11-05T00:01:42.600ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15952024-11-05T00:01:42.602ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b0d5b9b4-0d02-4914-8a29-68226a3f497b", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15962024-11-05T00:01:42.602ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15972024-11-05T00:01:42.604ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b0df802c-fb5d-4c68-9e11-42f83c722c8e", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15982024-11-05T00:01:42.604ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15992024-11-05T00:01:42.609ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16002024-11-05T00:01:42.609ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16012024-11-05T00:01:42.609ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7b288b91-6b8d-4eb4-91c0-f5a6dde9bfe9", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} })
16022024-11-05T00:01:42.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16032024-11-05T00:01:42.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16042024-11-05T00:01:42.610ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16052024-11-05T00:01:42.610ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 439.232847ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16062024-11-05T00:01:42.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16072024-11-05T00:01:42.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16082024-11-05T00:01:42.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16092024-11-05T00:01:42.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16102024-11-05T00:01:42.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16112024-11-05T00:01:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16122024-11-05T00:01:42.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16132024-11-05T00:01:42.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16142024-11-05T00:01:42.618ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16152024-11-05T00:01:42.618ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16162024-11-05T00:01:42.618ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 447.137358ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16172024-11-05T00:01:42.621ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16182024-11-05T00:01:42.621ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16192024-11-05T00:01:42.621ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d401fbfd-182b-420a-9108-042dbafc7416", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} })
16202024-11-05T00:01:42.623ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 452.07731ms iteration = 15 status = {}
16212024-11-05T00:01:42.623ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16222024-11-05T00:01:42.623ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 0 version = 2
16232024-11-05T00:01:42.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16242024-11-05T00:01:42.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16252024-11-05T00:01:42.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16262024-11-05T00:01:42.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16272024-11-05T00:01:42.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16282024-11-05T00:01:42.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16292024-11-05T00:01:42.655ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16302024-11-05T00:01:42.655ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 485.023927ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16312024-11-05T00:01:42.657ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-04T23:54:39.943212Z, time_modified: 2024-11-04T23:54:39.943212Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }) }
16322024-11-05T00:01:42.657ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 486.216991ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]}},"default_endpoint":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16332024-11-05T00:01:42.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16342024-11-05T00:01:42.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16352024-11-05T00:01:42.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16362024-11-05T00:01:42.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16372024-11-05T00:01:42.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16382024-11-05T00:01:42.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16392024-11-05T00:01:42.659ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16402024-11-05T00:01:42.660ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 1 version = 2
16412024-11-05T00:01:42.660ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16422024-11-05T00:01:42.660ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-04 23:54:45.073528 UTC dns_group = external generation = 2
16432024-11-05T00:01:42.660ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 489.365456ms iteration = 8 status = {"generation":2}
16442024-11-05T00:01:42.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16452024-11-05T00:01:42.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16462024-11-05T00:01:42.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16472024-11-05T00:01:42.724ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16482024-11-05T00:01:42.724ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5e20294-b0fb-493f-9665-e981585a5cf6", "content-length": "691", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} })
16492024-11-05T00:01:42.724ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16502024-11-05T00:01:42.724ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16512024-11-05T00:01:42.724ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16522024-11-05T00:01:42.726ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 555.935173ms iteration = 15 status = {}
16532024-11-05T00:01:42.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16542024-11-05T00:01:42.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16552024-11-05T00:01:42.749ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
16562024-11-05T00:01:42.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16572024-11-05T00:01:42.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16582024-11-05T00:01:42.759ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16592024-11-05T00:01:42.759ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfff5c36-efd2-43e9-83c8-c32e9f7141a7", "content-length": "134", "date": "Tue, 05 Nov 2024 00:01:41 GMT"} })
16602024-11-05T00:01:42.759ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16612024-11-05T00:01:42.759ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
16622024-11-05T00:01:42.759ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16632024-11-05T00:01:42.759ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16642024-11-05T00:01:42.759ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16652024-11-05T00:01:42.759ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16662024-11-05T00:01:42.759ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16672024-11-05T00:01:42.759ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16682024-11-05T00:01:42.760ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16692024-11-05T00:01:42.760ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16702024-11-05T00:01:42.760ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
16712024-11-05T00:01:42.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16722024-11-05T00:01:42.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16732024-11-05T00:01:42.762ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16742024-11-05T00:01:42.762ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4cb80bc-a1bd-4261-92dd-5f5e2b9126fe", "content-length": "2", "date": "Tue, 05 Nov 2024 00:01:41 GMT"} })
16752024-11-05T00:01:42.762ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16762024-11-05T00:01:42.762ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c76d06d-ab90-4764-a070-4d6b5c64d86f", "content-length": "52", "date": "Tue, 05 Nov 2024 00:01:41 GMT"} })
16772024-11-05T00:01:42.762ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
16782024-11-05T00:01:42.762ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16792024-11-05T00:01:42.963ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "baf32a5f-1b63-42b2-b7b9-2bc18449b1a2", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} })
16802024-11-05T00:01:42.963ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
16812024-11-05T00:01:42.963ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16822024-11-05T00:01:42.967ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "73faeca8-ae5c-4ac0-8d75-5d60a826c4ed", "content-length": "682", "date": "Tue, 05 Nov 2024 00:01:42 GMT"} })
16832024-11-05T00:01:42.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16842024-11-05T00:01:42.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16852024-11-05T00:01:42.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16862024-11-05T00:01:42.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16872024-11-05T00:01:42.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16882024-11-05T00:01:42.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16892024-11-05T00:01:42.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16902024-11-05T00:01:42.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16912024-11-05T00:01:42.984ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 813.376507ms iteration = 15 status = {}
16922024-11-05T00:01:43.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 43e1a90d-3e94-46d8-b247-4ede0fe3a947 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
16932024-11-05T00:01:43.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 43e1a90d-3e94-46d8-b247-4ede0fe3a947 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
16942024-11-05T00:01:43.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 43e1a90d-3e94-46d8-b247-4ede0fe3a947 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
16952024-11-05T00:01:44.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a75b64d8-89cf-4eef-81fd-303f30a27fc9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
16962024-11-05T00:01:44.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a75b64d8-89cf-4eef-81fd-303f30a27fc9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
16972024-11-05T00:01:44.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a75b64d8-89cf-4eef-81fd-303f30a27fc9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
16982024-11-05T00:01:45.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d698388-8cae-4386-b4e3-b07ba23e226a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
16992024-11-05T00:01:45.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d698388-8cae-4386-b4e3-b07ba23e226a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17002024-11-05T00:01:45.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d698388-8cae-4386-b4e3-b07ba23e226a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17012024-11-05T00:01:46.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 67b41754-2015-4360-bfc7-2723814e3ff0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17022024-11-05T00:01:46.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 67b41754-2015-4360-bfc7-2723814e3ff0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17032024-11-05T00:01:46.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 67b41754-2015-4360-bfc7-2723814e3ff0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17042024-11-05T00:01:47.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0152368a-7d2f-422e-8732-3b062f51fd36 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17052024-11-05T00:01:47.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0152368a-7d2f-422e-8732-3b062f51fd36 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17062024-11-05T00:01:47.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0152368a-7d2f-422e-8732-3b062f51fd36 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17072024-11-05T00:01:48.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8a5b96ec-5c8c-4a9b-9f8f-c2d32270e5ed roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17082024-11-05T00:01:48.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8a5b96ec-5c8c-4a9b-9f8f-c2d32270e5ed resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17092024-11-05T00:01:48.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8a5b96ec-5c8c-4a9b-9f8f-c2d32270e5ed response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17102024-11-05T00:01:49.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 055b618c-9d13-4d5d-b97d-0bcb6cf75153 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17112024-11-05T00:01:49.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 055b618c-9d13-4d5d-b97d-0bcb6cf75153 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17122024-11-05T00:01:49.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 055b618c-9d13-4d5d-b97d-0bcb6cf75153 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17132024-11-05T00:01:50.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 916299c4-a267-41a7-b496-7b0371ab5bc2 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17142024-11-05T00:01:50.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 916299c4-a267-41a7-b496-7b0371ab5bc2 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17152024-11-05T00:01:50.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 916299c4-a267-41a7-b496-7b0371ab5bc2 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17162024-11-05T00:01:51.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 398d54bb-df41-422b-b726-7738b3baece7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17172024-11-05T00:01:51.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 398d54bb-df41-422b-b726-7738b3baece7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17182024-11-05T00:01:51.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 398d54bb-df41-422b-b726-7738b3baece7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17192024-11-05T00:01:51.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 742 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 810a3370-41aa-4d1f-b439-cebc0e3e6c16 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
17202024-11-05T00:01:52.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
17212024-11-05T00:01:52.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17222024-11-05T00:01:52.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
17232024-11-05T00:01:52.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17242024-11-05T00:01:52.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17252024-11-05T00:01:52.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17262024-11-05T00:01:52.199ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17272024-11-05T00:01:52.199ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17282024-11-05T00:01:52.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17292024-11-05T00:01:52.201ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.106989ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17302024-11-05T00:01:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17312024-11-05T00:01:52.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17322024-11-05T00:01:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17332024-11-05T00:01:52.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17342024-11-05T00:01:52.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17352024-11-05T00:01:52.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17362024-11-05T00:01:52.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
17372024-11-05T00:01:52.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17382024-11-05T00:01:52.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17392024-11-05T00:01:52.218ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
17402024-11-05T00:01:52.218ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.759131ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
17412024-11-05T00:01:52.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bb53c3ae-e678-4bda-82e9-f05ad965d481 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17422024-11-05T00:01:52.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bb53c3ae-e678-4bda-82e9-f05ad965d481 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17432024-11-05T00:01:52.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bb53c3ae-e678-4bda-82e9-f05ad965d481 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17442024-11-05T00:01:53.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c012cb80-a843-49d8-9df3-e56b65a4bf3e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17452024-11-05T00:01:53.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c012cb80-a843-49d8-9df3-e56b65a4bf3e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17462024-11-05T00:01:53.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c012cb80-a843-49d8-9df3-e56b65a4bf3e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17472024-11-05T00:01:54.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8bc48eba-fff7-4ec5-a0e1-b11744f77b96 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17482024-11-05T00:01:54.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8bc48eba-fff7-4ec5-a0e1-b11744f77b96 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17492024-11-05T00:01:54.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8bc48eba-fff7-4ec5-a0e1-b11744f77b96 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17502024-11-05T00:01:55.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d549e930-5903-41c7-84e9-92fbbb016ea3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17512024-11-05T00:01:55.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d549e930-5903-41c7-84e9-92fbbb016ea3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17522024-11-05T00:01:55.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d549e930-5903-41c7-84e9-92fbbb016ea3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17532024-11-05T00:01:56.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8764f589-351d-4bf0-97d9-1b7deaa14c16 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17542024-11-05T00:01:56.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8764f589-351d-4bf0-97d9-1b7deaa14c16 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17552024-11-05T00:01:56.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8764f589-351d-4bf0-97d9-1b7deaa14c16 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17562024-11-05T00:01:57.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 19f99969-4b7c-4c67-9995-4cbc8798d288 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17572024-11-05T00:01:57.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 19f99969-4b7c-4c67-9995-4cbc8798d288 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17582024-11-05T00:01:57.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 19f99969-4b7c-4c67-9995-4cbc8798d288 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17592024-11-05T00:01:58.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2a686c35-1bf5-4cb0-8cb4-476e08ac5692 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17602024-11-05T00:01:58.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2a686c35-1bf5-4cb0-8cb4-476e08ac5692 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17612024-11-05T00:01:58.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2a686c35-1bf5-4cb0-8cb4-476e08ac5692 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17622024-11-05T00:01:59.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d410e1a7-3d85-458b-b006-45d90f0cd131 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17632024-11-05T00:01:59.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d410e1a7-3d85-458b-b006-45d90f0cd131 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17642024-11-05T00:01:59.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d410e1a7-3d85-458b-b006-45d90f0cd131 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17652024-11-05T00:02:00.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b4afe7cb-96b5-4afc-b88b-02292adda07d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17662024-11-05T00:02:00.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b4afe7cb-96b5-4afc-b88b-02292adda07d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17672024-11-05T00:02:00.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b4afe7cb-96b5-4afc-b88b-02292adda07d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17682024-11-05T00:02:01.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e340d196-ed8c-4a89-a63f-f9297cefe50c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17692024-11-05T00:02:01.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e340d196-ed8c-4a89-a63f-f9297cefe50c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17702024-11-05T00:02:01.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e340d196-ed8c-4a89-a63f-f9297cefe50c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17712024-11-05T00:02:02.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
17722024-11-05T00:02:02.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
17732024-11-05T00:02:02.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17742024-11-05T00:02:02.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17752024-11-05T00:02:02.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17762024-11-05T00:02:02.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17772024-11-05T00:02:02.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17782024-11-05T00:02:02.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17792024-11-05T00:02:02.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17802024-11-05T00:02:02.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.553244ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17812024-11-05T00:02:02.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17822024-11-05T00:02:02.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17832024-11-05T00:02:02.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17842024-11-05T00:02:02.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17852024-11-05T00:02:02.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17862024-11-05T00:02:02.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17872024-11-05T00:02:02.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
17882024-11-05T00:02:02.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17892024-11-05T00:02:02.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17902024-11-05T00:02:02.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
17912024-11-05T00:02:02.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.688255ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
17922024-11-05T00:02:02.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2b9de65f-370c-4cd3-a691-5f97652c3ec4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17932024-11-05T00:02:02.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2b9de65f-370c-4cd3-a691-5f97652c3ec4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17942024-11-05T00:02:02.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2b9de65f-370c-4cd3-a691-5f97652c3ec4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17952024-11-05T00:02:03.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07428d10-f970-4535-bb91-f463bc9f5aee roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17962024-11-05T00:02:03.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07428d10-f970-4535-bb91-f463bc9f5aee resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17972024-11-05T00:02:03.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07428d10-f970-4535-bb91-f463bc9f5aee response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17982024-11-05T00:02:04.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1c87f047-280e-418c-9c73-9ebdcd3d4df1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17992024-11-05T00:02:04.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1c87f047-280e-418c-9c73-9ebdcd3d4df1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18002024-11-05T00:02:04.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1c87f047-280e-418c-9c73-9ebdcd3d4df1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18012024-11-05T00:02:05.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f0173e6d-755c-4ffa-b6b6-bc10078142bc roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18022024-11-05T00:02:05.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f0173e6d-755c-4ffa-b6b6-bc10078142bc resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18032024-11-05T00:02:05.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f0173e6d-755c-4ffa-b6b6-bc10078142bc response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18042024-11-05T00:02:06.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 000f9bc5-bd6f-4592-9e76-243888f2e4fe roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18052024-11-05T00:02:06.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 000f9bc5-bd6f-4592-9e76-243888f2e4fe resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18062024-11-05T00:02:06.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 000f9bc5-bd6f-4592-9e76-243888f2e4fe response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18072024-11-05T00:02:06.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 962 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = f86f3200-422f-4679-8b0d-8e175845f2da response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
18082024-11-05T00:02:07.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bcad9b15-f861-4e1f-9458-204916fd0cfa roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18092024-11-05T00:02:07.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bcad9b15-f861-4e1f-9458-204916fd0cfa resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18102024-11-05T00:02:07.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bcad9b15-f861-4e1f-9458-204916fd0cfa response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18112024-11-05T00:02:08.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b0c24b67-4e87-4b29-b8fc-1ce2897f4afb roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18122024-11-05T00:02:08.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b0c24b67-4e87-4b29-b8fc-1ce2897f4afb resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18132024-11-05T00:02:08.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b0c24b67-4e87-4b29-b8fc-1ce2897f4afb response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18142024-11-05T00:02:09.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bf3c3f72-4db0-4454-97ea-500ac78ae776 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18152024-11-05T00:02:09.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bf3c3f72-4db0-4454-97ea-500ac78ae776 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18162024-11-05T00:02:09.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bf3c3f72-4db0-4454-97ea-500ac78ae776 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18172024-11-05T00:02:10.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 43f8b211-1170-4643-93aa-00a8d34a99f9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18182024-11-05T00:02:10.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 43f8b211-1170-4643-93aa-00a8d34a99f9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18192024-11-05T00:02:10.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 43f8b211-1170-4643-93aa-00a8d34a99f9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18202024-11-05T00:02:11.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3be8ef5f-f356-40d3-8ead-fc6382ec6fb3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18212024-11-05T00:02:11.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3be8ef5f-f356-40d3-8ead-fc6382ec6fb3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18222024-11-05T00:02:11.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3be8ef5f-f356-40d3-8ead-fc6382ec6fb3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18232024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
18242024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
18252024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18262024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
18272024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18282024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18292024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18302024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
18312024-11-05T00:02:12.171ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18322024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
18332024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18342024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
18352024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
18362024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18372024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
18382024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18392024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
18402024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18412024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18422024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
18432024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18442024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
18452024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18462024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
18472024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
18482024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18492024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18502024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
18512024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.331\u{b5}s iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
18522024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
18532024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
18542024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.4\u{b5}s iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18552024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.43\u{b5}s iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18562024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
18572024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16\u{b5}s iteration = 16 status = {"errors":[],"records_set_to_done":[]}
18582024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18592024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18602024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18612024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18622024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18632024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18642024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18652024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18662024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18672024-11-05T00:02:12.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18682024-11-05T00:02:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18692024-11-05T00:02:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18702024-11-05T00:02:12.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18712024-11-05T00:02:12.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18722024-11-05T00:02:12.174ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2775, tv_nsec: 762369355 } })
18732024-11-05T00:02:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.631234ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18742024-11-05T00:02:12.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18752024-11-05T00:02:12.174ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
18762024-11-05T00:02:12.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18772024-11-05T00:02:12.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18782024-11-05T00:02:12.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18792024-11-05T00:02:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18802024-11-05T00:02:12.177ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18812024-11-05T00:02:12.177ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2775, tv_nsec: 764808945 } })
18822024-11-05T00:02:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18832024-11-05T00:02:12.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18842024-11-05T00:02:12.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
18852024-11-05T00:02:12.177ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18862024-11-05T00:02:12.177ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18872024-11-05T00:02:12.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18882024-11-05T00:02:12.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18892024-11-05T00:02:12.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18902024-11-05T00:02:12.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18912024-11-05T00:02:12.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18922024-11-05T00:02:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18932024-11-05T00:02:12.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18942024-11-05T00:02:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18952024-11-05T00:02:12.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18962024-11-05T00:02:12.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18972024-11-05T00:02:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18982024-11-05T00:02:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18992024-11-05T00:02:12.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19002024-11-05T00:02:12.181ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19012024-11-05T00:02:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19022024-11-05T00:02:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19032024-11-05T00:02:12.186ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2775, tv_nsec: 774072925 } })
19042024-11-05T00:02:12.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052024-11-05T00:02:12.186ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
19062024-11-05T00:02:12.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19072024-11-05T00:02:12.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19082024-11-05T00:02:12.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19092024-11-05T00:02:12.189ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19102024-11-05T00:02:12.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19112024-11-05T00:02:12.191ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19122024-11-05T00:02:12.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
19132024-11-05T00:02:12.194ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19142024-11-05T00:02:12.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19152024-11-05T00:02:12.210ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
19162024-11-05T00:02:12.210ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.99357ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
19172024-11-05T00:02:12.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19182024-11-05T00:02:12.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19192024-11-05T00:02:12.219ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19202024-11-05T00:02:12.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19212024-11-05T00:02:12.219ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19222024-11-05T00:02:12.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19232024-11-05T00:02:12.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19242024-11-05T00:02:12.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19252024-11-05T00:02:12.222ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19262024-11-05T00:02:12.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19272024-11-05T00:02:12.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19282024-11-05T00:02:12.225ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19292024-11-05T00:02:12.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19302024-11-05T00:02:12.227ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19312024-11-05T00:02:12.227ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19322024-11-05T00:02:12.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19332024-11-05T00:02:12.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19342024-11-05T00:02:12.227ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19352024-11-05T00:02:12.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19362024-11-05T00:02:12.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19372024-11-05T00:02:12.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19382024-11-05T00:02:12.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
19392024-11-05T00:02:12.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19402024-11-05T00:02:12.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19412024-11-05T00:02:12.276ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19422024-11-05T00:02:12.276ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 104.803861ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19432024-11-05T00:02:12.289ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19442024-11-05T00:02:12.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19452024-11-05T00:02:12.303ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
19462024-11-05T00:02:12.303ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19472024-11-05T00:02:12.304ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85223708-da92-4783-a135-9c09380b4c54", "content-length": "26", "date": "Tue, 05 Nov 2024 00:02:12 GMT"} })
19482024-11-05T00:02:12.304ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19492024-11-05T00:02:12.306ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19502024-11-05T00:02:12.326ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19512024-11-05T00:02:12.326ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19522024-11-05T00:02:12.327ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef0abc2e-652a-4bb4-a921-b42a3a00e35e", "content-length": "372", "date": "Tue, 05 Nov 2024 00:02:12 GMT"} })
19532024-11-05T00:02:12.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19542024-11-05T00:02:12.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19552024-11-05T00:02:12.331ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 160.598716ms iteration = 16 status = 0
19562024-11-05T00:02:12.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 189.567101ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19572024-11-05T00:02:12.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 192.135124ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19582024-11-05T00:02:12.366ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19592024-11-05T00:02:12.366ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19602024-11-05T00:02:12.366ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 195.312579ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19612024-11-05T00:02:12.381ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
19622024-11-05T00:02:12.381ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19632024-11-05T00:02:12.381ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "640a991b-d0c3-4df6-bbb4-98b7727375d2", "date": "Tue, 05 Nov 2024 00:02:12 GMT"} })
19642024-11-05T00:02:12.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19652024-11-05T00:02:12.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19662024-11-05T00:02:12.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19672024-11-05T00:02:12.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19682024-11-05T00:02:12.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19692024-11-05T00:02:12.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19702024-11-05T00:02:12.391ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19712024-11-05T00:02:12.391ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19722024-11-05T00:02:12.392ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cd36bb5b-f263-43c7-b3d6-c610d16df5ac", "date": "Tue, 05 Nov 2024 00:02:12 GMT"} })
19732024-11-05T00:02:12.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
19742024-11-05T00:02:12.393ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19752024-11-05T00:02:12.393ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4a6eaf6-6b74-4b70-8987-ef87d0b40d79", "content-length": "26", "date": "Tue, 05 Nov 2024 00:02:12 GMT"} })
19762024-11-05T00:02:12.393ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 222.67667ms iteration = 16 status = {}
19772024-11-05T00:02:12.394ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19782024-11-05T00:02:12.395ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
19792024-11-05T00:02:12.395ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19802024-11-05T00:02:12.395ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19812024-11-05T00:02:12.395ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "005db43e-5096-4987-8a7d-899145c4e3b0", "content-length": "26", "date": "Tue, 05 Nov 2024 00:02:12 GMT"} })
19822024-11-05T00:02:12.395ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19832024-11-05T00:02:12.396ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
19842024-11-05T00:02:12.398ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 227.243494ms iteration = 16 status = {}
19852024-11-05T00:02:12.431ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 259.998016ms iteration = 18 status = {"physical_disks_added":0}
19862024-11-05T00:02:12.439ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19872024-11-05T00:02:12.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19882024-11-05T00:02:12.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19892024-11-05T00:02:12.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19902024-11-05T00:02:12.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19912024-11-05T00:02:12.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19922024-11-05T00:02:12.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19932024-11-05T00:02:12.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19942024-11-05T00:02:12.446ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19952024-11-05T00:02:12.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19962024-11-05T00:02:12.459ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19972024-11-05T00:02:12.459ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "62798fc6-17cd-4412-b8f4-f9acd620c96d", "content-length": "1", "date": "Tue, 05 Nov 2024 00:02:11 GMT"} })
19982024-11-05T00:02:12.461ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19992024-11-05T00:02:12.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20002024-11-05T00:02:12.464ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 292.806601ms iteration = 16 status = null
20012024-11-05T00:02:12.517ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20022024-11-05T00:02:12.518ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "91d1b417-caf6-4abe-8283-75853fee737f", "content-length": "691", "date": "Tue, 05 Nov 2024 00:02:12 GMT"} })
20032024-11-05T00:02:12.518ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20042024-11-05T00:02:12.518ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20052024-11-05T00:02:12.518ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
20062024-11-05T00:02:12.519ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 348.724758ms iteration = 16 status = {}
20072024-11-05T00:02:12.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20082024-11-05T00:02:12.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20092024-11-05T00:02:12.570ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
20102024-11-05T00:02:12.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20112024-11-05T00:02:12.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20122024-11-05T00:02:12.581ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20132024-11-05T00:02:12.581ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb176638-b89b-4ba5-b3b6-a49fb5a64f9c", "content-length": "134", "date": "Tue, 05 Nov 2024 00:02:11 GMT"} })
20142024-11-05T00:02:12.581ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20152024-11-05T00:02:12.581ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
20162024-11-05T00:02:12.582ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20172024-11-05T00:02:12.582ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20182024-11-05T00:02:12.582ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20192024-11-05T00:02:12.582ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20202024-11-05T00:02:12.582ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20212024-11-05T00:02:12.582ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20222024-11-05T00:02:12.582ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20232024-11-05T00:02:12.582ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20242024-11-05T00:02:12.582ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
20252024-11-05T00:02:12.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20262024-11-05T00:02:12.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20272024-11-05T00:02:12.584ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20282024-11-05T00:02:12.584ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff7f1c87-7f58-4c83-8c52-71b41a81cec4", "content-length": "2", "date": "Tue, 05 Nov 2024 00:02:11 GMT"} })
20292024-11-05T00:02:12.584ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20302024-11-05T00:02:12.584ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d538d5e-dcae-46b3-8ac6-0c27b6e5a772", "content-length": "52", "date": "Tue, 05 Nov 2024 00:02:11 GMT"} })
20312024-11-05T00:02:12.584ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
20322024-11-05T00:02:12.584ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20332024-11-05T00:02:12.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 86667beb-2b29-48b1-8c79-218cf304a5c5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20342024-11-05T00:02:12.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 86667beb-2b29-48b1-8c79-218cf304a5c5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20352024-11-05T00:02:12.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 86667beb-2b29-48b1-8c79-218cf304a5c5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20362024-11-05T00:02:12.774ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2d415635-8bb7-4226-a527-ce71bbf8fc17", "date": "Tue, 05 Nov 2024 00:02:12 GMT"} })
20372024-11-05T00:02:12.774ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
20382024-11-05T00:02:12.774ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20392024-11-05T00:02:12.779ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "61af86c7-c4f8-4a64-981f-5718cb1d7aec", "content-length": "682", "date": "Tue, 05 Nov 2024 00:02:12 GMT"} })
20402024-11-05T00:02:12.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20412024-11-05T00:02:12.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20422024-11-05T00:02:12.783ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20432024-11-05T00:02:12.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20442024-11-05T00:02:12.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20452024-11-05T00:02:12.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20462024-11-05T00:02:12.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20472024-11-05T00:02:12.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20482024-11-05T00:02:12.796ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 625.352346ms iteration = 16 status = {}
20492024-11-05T00:02:13.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c11ef3fa-422d-4baa-baae-8efd9f9fc751 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20502024-11-05T00:02:13.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c11ef3fa-422d-4baa-baae-8efd9f9fc751 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20512024-11-05T00:02:13.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c11ef3fa-422d-4baa-baae-8efd9f9fc751 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20522024-11-05T00:02:14.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8b93b58e-405b-426e-b915-47205621bb62 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20532024-11-05T00:02:14.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8b93b58e-405b-426e-b915-47205621bb62 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20542024-11-05T00:02:14.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8b93b58e-405b-426e-b915-47205621bb62 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20552024-11-05T00:02:15.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a98f63ff-80a2-437d-9e23-d64ac643be76 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20562024-11-05T00:02:15.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a98f63ff-80a2-437d-9e23-d64ac643be76 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20572024-11-05T00:02:15.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a98f63ff-80a2-437d-9e23-d64ac643be76 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20582024-11-05T00:02:16.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1dc002c7-a101-4fad-bc15-9014d54a2069 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20592024-11-05T00:02:16.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1dc002c7-a101-4fad-bc15-9014d54a2069 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20602024-11-05T00:02:16.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1dc002c7-a101-4fad-bc15-9014d54a2069 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20612024-11-05T00:02:17.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8f7a8990-bd9a-445e-9c73-2c16dd166d42 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20622024-11-05T00:02:17.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8f7a8990-bd9a-445e-9c73-2c16dd166d42 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20632024-11-05T00:02:17.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8f7a8990-bd9a-445e-9c73-2c16dd166d42 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20642024-11-05T00:02:18.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 95bc86fa-7205-4f72-a639-243450f319b1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20652024-11-05T00:02:18.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 95bc86fa-7205-4f72-a639-243450f319b1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20662024-11-05T00:02:18.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 95bc86fa-7205-4f72-a639-243450f319b1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20672024-11-05T00:02:19.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a3d10cf3-f470-428d-a059-9407e1423c31 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20682024-11-05T00:02:19.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a3d10cf3-f470-428d-a059-9407e1423c31 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20692024-11-05T00:02:19.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a3d10cf3-f470-428d-a059-9407e1423c31 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20702024-11-05T00:02:20.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d43c67f-a210-4cc2-992b-3bf27ea11123 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20712024-11-05T00:02:20.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d43c67f-a210-4cc2-992b-3bf27ea11123 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20722024-11-05T00:02:20.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d43c67f-a210-4cc2-992b-3bf27ea11123 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20732024-11-05T00:02:21.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 491 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 120814b3-c9af-4fbc-9b57-1cfc5446c458 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
20742024-11-05T00:02:21.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 96365870-73d3-4e51-8a80-485da240446c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20752024-11-05T00:02:21.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 96365870-73d3-4e51-8a80-485da240446c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20762024-11-05T00:02:21.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 96365870-73d3-4e51-8a80-485da240446c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20772024-11-05T00:02:22.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
20782024-11-05T00:02:22.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20792024-11-05T00:02:22.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
20802024-11-05T00:02:22.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20812024-11-05T00:02:22.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20822024-11-05T00:02:22.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20832024-11-05T00:02:22.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20842024-11-05T00:02:22.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20852024-11-05T00:02:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20862024-11-05T00:02:22.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20872024-11-05T00:02:22.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20882024-11-05T00:02:22.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20892024-11-05T00:02:22.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20902024-11-05T00:02:22.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20912024-11-05T00:02:22.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20922024-11-05T00:02:22.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
20932024-11-05T00:02:22.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20942024-11-05T00:02:22.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20952024-11-05T00:02:22.193ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
20962024-11-05T00:02:22.193ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.187045ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
20972024-11-05T00:02:22.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.513727ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20982024-11-05T00:02:22.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 81e21346-9f27-45ca-91f3-c31fbe6d373e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
20992024-11-05T00:02:22.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 81e21346-9f27-45ca-91f3-c31fbe6d373e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21002024-11-05T00:02:22.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 81e21346-9f27-45ca-91f3-c31fbe6d373e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21012024-11-05T00:02:24.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 90799d46-8fa4-4534-91a0-3a6987765c80 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21022024-11-05T00:02:24.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 90799d46-8fa4-4534-91a0-3a6987765c80 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21032024-11-05T00:02:24.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 90799d46-8fa4-4534-91a0-3a6987765c80 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21042024-11-05T00:02:25.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5937e937-57aa-4636-b556-0431e9685a3e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21052024-11-05T00:02:25.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5937e937-57aa-4636-b556-0431e9685a3e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21062024-11-05T00:02:25.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5937e937-57aa-4636-b556-0431e9685a3e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21072024-11-05T00:02:26.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 181a2378-3ff3-4ba8-a27b-326a7a2d26e9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21082024-11-05T00:02:26.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 181a2378-3ff3-4ba8-a27b-326a7a2d26e9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21092024-11-05T00:02:26.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 181a2378-3ff3-4ba8-a27b-326a7a2d26e9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21102024-11-05T00:02:26.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 3def176d-0307-4f0d-893a-4cba054959aa roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
21112024-11-05T00:02:26.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 3def176d-0307-4f0d-893a-4cba054959aa resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
21122024-11-05T00:02:26.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 3def176d-0307-4f0d-893a-4cba054959aa response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
21132024-11-05T00:02:26.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = eaf73ae4-4206-4817-b305-0b78611ab767 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
21142024-11-05T00:02:26.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = eaf73ae4-4206-4817-b305-0b78611ab767 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
21152024-11-05T00:02:26.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = eaf73ae4-4206-4817-b305-0b78611ab767 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
21162024-11-05T00:02:27.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 81cf9a2b-44d7-42f3-bbbc-c2e888a43546 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21172024-11-05T00:02:27.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 81cf9a2b-44d7-42f3-bbbc-c2e888a43546 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21182024-11-05T00:02:27.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 81cf9a2b-44d7-42f3-bbbc-c2e888a43546 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21192024-11-05T00:02:28.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 20ca7ce2-6d0f-4649-a7d6-350e223a127e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21202024-11-05T00:02:28.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 20ca7ce2-6d0f-4649-a7d6-350e223a127e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21212024-11-05T00:02:28.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 20ca7ce2-6d0f-4649-a7d6-350e223a127e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21222024-11-05T00:02:29.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07365a11-fa66-415b-9dc3-22cded6dde71 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21232024-11-05T00:02:29.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07365a11-fa66-415b-9dc3-22cded6dde71 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21242024-11-05T00:02:29.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 07365a11-fa66-415b-9dc3-22cded6dde71 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21252024-11-05T00:02:30.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f5d18328-433a-466e-8988-d83235fe408a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21262024-11-05T00:02:30.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f5d18328-433a-466e-8988-d83235fe408a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21272024-11-05T00:02:30.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f5d18328-433a-466e-8988-d83235fe408a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21282024-11-05T00:02:31.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fa8ae933-bad3-45c5-bea5-897a9c4b11bd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21292024-11-05T00:02:31.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fa8ae933-bad3-45c5-bea5-897a9c4b11bd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21302024-11-05T00:02:31.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fa8ae933-bad3-45c5-bea5-897a9c4b11bd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21312024-11-05T00:02:32.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
21322024-11-05T00:02:32.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
21332024-11-05T00:02:32.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21342024-11-05T00:02:32.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21352024-11-05T00:02:32.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21362024-11-05T00:02:32.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21372024-11-05T00:02:32.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 714ca892-3609-4156-b55e-f9758a2b20ae roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21382024-11-05T00:02:32.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 714ca892-3609-4156-b55e-f9758a2b20ae resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21392024-11-05T00:02:32.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 714ca892-3609-4156-b55e-f9758a2b20ae response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21402024-11-05T00:02:32.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21412024-11-05T00:02:32.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21422024-11-05T00:02:32.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21432024-11-05T00:02:32.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21442024-11-05T00:02:32.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21452024-11-05T00:02:32.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21462024-11-05T00:02:32.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21472024-11-05T00:02:32.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21482024-11-05T00:02:32.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21492024-11-05T00:02:32.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.482029ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21502024-11-05T00:02:32.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
21512024-11-05T00:02:32.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21522024-11-05T00:02:32.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21532024-11-05T00:02:32.220ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
21542024-11-05T00:02:32.220ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.120279ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
21552024-11-05T00:02:33.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac12ad96-ada2-4665-883a-c4885257271f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21562024-11-05T00:02:33.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac12ad96-ada2-4665-883a-c4885257271f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21572024-11-05T00:02:33.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac12ad96-ada2-4665-883a-c4885257271f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21582024-11-05T00:02:34.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8f63cbb6-2745-45b6-8873-5e945080161c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21592024-11-05T00:02:34.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8f63cbb6-2745-45b6-8873-5e945080161c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21602024-11-05T00:02:34.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8f63cbb6-2745-45b6-8873-5e945080161c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21612024-11-05T00:02:35.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 918ce6a9-f7da-45e8-b36f-2d179a1aeb27 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21622024-11-05T00:02:35.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 918ce6a9-f7da-45e8-b36f-2d179a1aeb27 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21632024-11-05T00:02:35.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 918ce6a9-f7da-45e8-b36f-2d179a1aeb27 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21642024-11-05T00:02:36.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 270c6a01-77fe-4130-a62e-a9e8370fe53c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21652024-11-05T00:02:36.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 270c6a01-77fe-4130-a62e-a9e8370fe53c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21662024-11-05T00:02:36.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 270c6a01-77fe-4130-a62e-a9e8370fe53c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21672024-11-05T00:02:36.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 831 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = f06b2926-80d3-4314-b824-a2a45e13be8b response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
21682024-11-05T00:02:37.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2f303ced-63a9-4afe-8351-4c8562e363d5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21692024-11-05T00:02:37.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2f303ced-63a9-4afe-8351-4c8562e363d5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21702024-11-05T00:02:37.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2f303ced-63a9-4afe-8351-4c8562e363d5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21712024-11-05T00:02:38.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a6138b28-9685-487d-b497-a50625ec7285 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21722024-11-05T00:02:38.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a6138b28-9685-487d-b497-a50625ec7285 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21732024-11-05T00:02:38.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a6138b28-9685-487d-b497-a50625ec7285 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21742024-11-05T00:02:39.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f166ed48-0664-499e-af56-cbd19a2a4826 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21752024-11-05T00:02:39.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f166ed48-0664-499e-af56-cbd19a2a4826 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21762024-11-05T00:02:39.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f166ed48-0664-499e-af56-cbd19a2a4826 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21772024-11-05T00:02:40.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6ab2281-b944-4073-9050-609ebbb4af1d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21782024-11-05T00:02:40.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6ab2281-b944-4073-9050-609ebbb4af1d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21792024-11-05T00:02:40.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6ab2281-b944-4073-9050-609ebbb4af1d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21802024-11-05T00:02:41.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 37bdae01-9473-4156-8238-63378f06d719 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21812024-11-05T00:02:41.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 37bdae01-9473-4156-8238-63378f06d719 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21822024-11-05T00:02:41.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 37bdae01-9473-4156-8238-63378f06d719 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
21832024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
21842024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21852024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
21862024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21872024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
21882024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21892024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
21902024-11-05T00:02:42.171ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-04 23:52:42.171045600 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
21912024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21922024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
21932024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
21942024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21952024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
21962024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
21972024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21982024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
21992024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22002024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22012024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
22022024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22032024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
22042024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22052024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
22062024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22072024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
22082024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
22092024-11-05T00:02:42.171ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22102024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22112024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
22122024-11-05T00:02:42.171ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970
22132024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
22142024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.451\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970"}
22152024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
22162024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
22172024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22182024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22192024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22202024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
22212024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
22222024-11-05T00:02:42.171ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22232024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22242024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
22252024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
22262024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
22272024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22282024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22292024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
22302024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
22312024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22322024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22332024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22342024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22352024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22362024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22372024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22382024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22392024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22402024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22412024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22422024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22432024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22442024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22452024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
22462024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
22472024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
22482024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22492024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
22502024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.64\u{b5}s iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22512024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.061\u{b5}s iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
22522024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
22532024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
22542024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.22\u{b5}s iteration = 17 status = {"errors":[],"records_set_to_done":[]}
22552024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22562024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.26\u{b5}s iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22572024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22582024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22592024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22602024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22612024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22622024-11-05T00:02:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22632024-11-05T00:02:42.172ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f4c9dd5-dad6-4fc2-ba58-b064adbea295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2805, tv_nsec: 759286692 } })
22642024-11-05T00:02:42.172ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("08f058bf-bffa-4561-8799-2d5d32641d33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e5a3f00-3f5b-4cac-8aa4-99515a0afee2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2805, tv_nsec: 759315262 } })
22652024-11-05T00:02:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22662024-11-05T00:02:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22672024-11-05T00:02:42.172ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
22682024-11-05T00:02:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.121113ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
22692024-11-05T00:02:42.172ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22702024-11-05T00:02:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.246875ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22712024-11-05T00:02:42.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22722024-11-05T00:02:42.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22732024-11-05T00:02:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22742024-11-05T00:02:42.173ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-04 23:52:42.171045600 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
22752024-11-05T00:02:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.92432ms iteration = 9 status = {"expiration":"2024-11-04T23:52:42.171045600Z","pruned":[]}
22762024-11-05T00:02:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.553904ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22772024-11-05T00:02:42.174ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22782024-11-05T00:02:42.175ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2805, tv_nsec: 762664051 } })
22792024-11-05T00:02:42.175ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
22802024-11-05T00:02:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22812024-11-05T00:02:42.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22822024-11-05T00:02:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22832024-11-05T00:02:42.176ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22842024-11-05T00:02:42.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22852024-11-05T00:02:42.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22862024-11-05T00:02:42.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22872024-11-05T00:02:42.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22882024-11-05T00:02:42.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22892024-11-05T00:02:42.179ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2805, tv_nsec: 766763425 } })
22902024-11-05T00:02:42.179ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
22912024-11-05T00:02:42.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22922024-11-05T00:02:42.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22932024-11-05T00:02:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22942024-11-05T00:02:42.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22952024-11-05T00:02:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22962024-11-05T00:02:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22972024-11-05T00:02:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22982024-11-05T00:02:42.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22992024-11-05T00:02:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23002024-11-05T00:02:42.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23012024-11-05T00:02:42.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23022024-11-05T00:02:42.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23032024-11-05T00:02:42.184ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23042024-11-05T00:02:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23052024-11-05T00:02:42.186ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23062024-11-05T00:02:42.186ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.60673ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
23072024-11-05T00:02:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23082024-11-05T00:02:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
23092024-11-05T00:02:42.186ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23102024-11-05T00:02:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23112024-11-05T00:02:42.188ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23122024-11-05T00:02:42.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23132024-11-05T00:02:42.189ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2805, tv_nsec: 777112698 } })
23142024-11-05T00:02:42.190ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
23152024-11-05T00:02:42.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23162024-11-05T00:02:42.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23172024-11-05T00:02:42.191ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23182024-11-05T00:02:42.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23192024-11-05T00:02:42.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23202024-11-05T00:02:42.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
23212024-11-05T00:02:42.196ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23222024-11-05T00:02:42.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23232024-11-05T00:02:42.218ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
23242024-11-05T00:02:42.218ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.148108ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
23252024-11-05T00:02:42.234ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23262024-11-05T00:02:42.234ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23272024-11-05T00:02:42.234ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23282024-11-05T00:02:42.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23292024-11-05T00:02:42.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23302024-11-05T00:02:42.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23312024-11-05T00:02:42.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23322024-11-05T00:02:42.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.275324ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23332024-11-05T00:02:42.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23342024-11-05T00:02:42.248ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23352024-11-05T00:02:42.248ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23362024-11-05T00:02:42.248ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.907889ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23372024-11-05T00:02:42.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23382024-11-05T00:02:42.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23392024-11-05T00:02:42.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23402024-11-05T00:02:42.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23412024-11-05T00:02:42.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23422024-11-05T00:02:42.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23432024-11-05T00:02:42.252ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23442024-11-05T00:02:42.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23452024-11-05T00:02:42.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23462024-11-05T00:02:42.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23472024-11-05T00:02:42.254ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23482024-11-05T00:02:42.254ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.972923ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23492024-11-05T00:02:42.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23502024-11-05T00:02:42.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23512024-11-05T00:02:42.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23522024-11-05T00:02:42.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23532024-11-05T00:02:42.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23542024-11-05T00:02:42.256ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23552024-11-05T00:02:42.256ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23562024-11-05T00:02:42.256ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.849391ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23572024-11-05T00:02:42.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23582024-11-05T00:02:42.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23592024-11-05T00:02:42.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23602024-11-05T00:02:42.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23612024-11-05T00:02:42.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23622024-11-05T00:02:42.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23632024-11-05T00:02:42.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23642024-11-05T00:02:42.296ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23652024-11-05T00:02:42.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23662024-11-05T00:02:42.301ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23672024-11-05T00:02:42.301ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23682024-11-05T00:02:42.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23692024-11-05T00:02:42.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23702024-11-05T00:02:42.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23712024-11-05T00:02:42.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23722024-11-05T00:02:42.303ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23732024-11-05T00:02:42.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23742024-11-05T00:02:42.308ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23752024-11-05T00:02:42.308ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23762024-11-05T00:02:42.308ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23772024-11-05T00:02:42.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23782024-11-05T00:02:42.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23792024-11-05T00:02:42.309ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23802024-11-05T00:02:42.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23812024-11-05T00:02:42.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23822024-11-05T00:02:42.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23832024-11-05T00:02:42.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23842024-11-05T00:02:42.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23852024-11-05T00:02:42.311ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23862024-11-05T00:02:42.311ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23872024-11-05T00:02:42.311ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23882024-11-05T00:02:42.311ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23892024-11-05T00:02:42.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23902024-11-05T00:02:42.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23912024-11-05T00:02:42.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23922024-11-05T00:02:42.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 143.129758ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23932024-11-05T00:02:42.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
23942024-11-05T00:02:42.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23952024-11-05T00:02:42.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23962024-11-05T00:02:42.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23972024-11-05T00:02:42.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23982024-11-05T00:02:42.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23992024-11-05T00:02:42.318ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 146.892305ms iteration = 17 status = 0
24002024-11-05T00:02:42.318ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24012024-11-05T00:02:42.318ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24022024-11-05T00:02:42.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24032024-11-05T00:02:42.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24042024-11-05T00:02:42.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24052024-11-05T00:02:42.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24062024-11-05T00:02:42.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24072024-11-05T00:02:42.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24082024-11-05T00:02:42.327ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
24092024-11-05T00:02:42.327ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24102024-11-05T00:02:42.327ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-04 23:54:43.769339 UTC dns_group = internal generation = 1
24112024-11-05T00:02:42.327ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 156.135105ms iteration = 9 status = {"generation":1}
24122024-11-05T00:02:42.340ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
24132024-11-05T00:02:42.340ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24142024-11-05T00:02:42.340ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3e39a5b-8b44-4182-80fb-0d30ea87ee55", "content-length": "26", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
24152024-11-05T00:02:42.340ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24162024-11-05T00:02:42.342ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24172024-11-05T00:02:42.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24182024-11-05T00:02:42.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24192024-11-05T00:02:42.350ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24202024-11-05T00:02:42.350ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24212024-11-05T00:02:42.350ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 179.086956ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24222024-11-05T00:02:42.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24232024-11-05T00:02:42.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24242024-11-05T00:02:42.359ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24252024-11-05T00:02:42.359ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-04T23:54:39.943212Z, time_modified: 2024-11-04T23:54:39.943212Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }) }
24262024-11-05T00:02:42.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24272024-11-05T00:02:42.359ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 188.841966ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]}},"default_endpoint":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
24282024-11-05T00:02:42.379ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
24292024-11-05T00:02:42.379ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24302024-11-05T00:02:42.379ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e24f10b-787c-4f26-9afc-161eeda7827a", "content-length": "26", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
24312024-11-05T00:02:42.379ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24322024-11-05T00:02:42.381ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24332024-11-05T00:02:42.398ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24342024-11-05T00:02:42.398ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 0 version = 2
24352024-11-05T00:02:42.398ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24362024-11-05T00:02:42.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24372024-11-05T00:02:42.398ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
24382024-11-05T00:02:42.398ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24392024-11-05T00:02:42.399ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "036c2714-7f6a-44b7-ba34-5dd171d160a5", "content-length": "26", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
24402024-11-05T00:02:42.399ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24412024-11-05T00:02:42.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
24422024-11-05T00:02:42.407ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24432024-11-05T00:02:42.410ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
24442024-11-05T00:02:42.410ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 239.094247ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
24452024-11-05T00:02:42.412ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 241.304413ms iteration = 19 status = {"physical_disks_added":0}
24462024-11-05T00:02:42.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24472024-11-05T00:02:42.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24482024-11-05T00:02:42.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bb134231-7f83-4b65-8383-65609e6c1b4b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24492024-11-05T00:02:42.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bb134231-7f83-4b65-8383-65609e6c1b4b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24502024-11-05T00:02:42.529ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24512024-11-05T00:02:42.530ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad9413eb-841d-4a7f-99d7-b4b0e43fffe1", "content-length": "1", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
24522024-11-05T00:02:42.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24532024-11-05T00:02:42.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24542024-11-05T00:02:42.544ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24552024-11-05T00:02:42.560ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24562024-11-05T00:02:42.560ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24572024-11-05T00:02:42.561ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "069256f7-950e-486d-b1fc-5e0ac6e27b02", "content-length": "372", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
24582024-11-05T00:02:42.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24592024-11-05T00:02:42.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24602024-11-05T00:02:42.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24612024-11-05T00:02:42.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bb134231-7f83-4b65-8383-65609e6c1b4b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24622024-11-05T00:02:42.565ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 394.695002ms iteration = 17 status = null
24632024-11-05T00:02:42.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24642024-11-05T00:02:42.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24652024-11-05T00:02:42.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24662024-11-05T00:02:42.570ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 1 version = 2
24672024-11-05T00:02:42.570ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24682024-11-05T00:02:42.570ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-04 23:54:45.073528 UTC dns_group = external generation = 2
24692024-11-05T00:02:42.570ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 398.832797ms iteration = 9 status = {"generation":2}
24702024-11-05T00:02:42.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24712024-11-05T00:02:42.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24722024-11-05T00:02:42.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24732024-11-05T00:02:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24742024-11-05T00:02:42.627ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24752024-11-05T00:02:42.627ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24762024-11-05T00:02:42.627ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b474d4c4-82a2-4ed8-a956-29c3fc6149d4", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
24772024-11-05T00:02:42.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24782024-11-05T00:02:42.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24792024-11-05T00:02:42.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24802024-11-05T00:02:42.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24812024-11-05T00:02:42.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24822024-11-05T00:02:42.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24832024-11-05T00:02:42.638ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24842024-11-05T00:02:42.638ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24852024-11-05T00:02:42.638ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2b983022-cefa-433a-bf87-b8b1799bd0e0", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
24862024-11-05T00:02:42.640ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 469.004097ms iteration = 17 status = {}
24872024-11-05T00:02:42.650ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24882024-11-05T00:02:42.650ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24892024-11-05T00:02:42.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24902024-11-05T00:02:42.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24912024-11-05T00:02:42.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24922024-11-05T00:02:42.680ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 509.450568ms iteration = 17 status = {}
24932024-11-05T00:02:42.792ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24942024-11-05T00:02:42.793ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "54c2cc6d-ad43-4646-a67f-44cdd486fd56", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24952024-11-05T00:02:42.793ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24962024-11-05T00:02:42.795ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "eeca2df5-baa0-4e52-9521-f585869451d3", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24972024-11-05T00:02:42.795ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24982024-11-05T00:02:42.797ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24992024-11-05T00:02:42.797ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 625.823567ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25002024-11-05T00:02:42.827ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25012024-11-05T00:02:42.830ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25022024-11-05T00:02:42.830ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5fb498d9-bfa2-4427-833a-43c0a4f032c6", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25032024-11-05T00:02:42.830ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25042024-11-05T00:02:42.832ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1dec8c77-2b81-4d8e-a43f-e7a29fb3b7aa", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25052024-11-05T00:02:42.832ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25062024-11-05T00:02:42.834ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "86db2926-2775-4aa7-a986-b2069a0baad1", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25072024-11-05T00:02:42.834ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25082024-11-05T00:02:42.836ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25092024-11-05T00:02:42.836ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 665.248276ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25102024-11-05T00:02:42.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25112024-11-05T00:02:42.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25122024-11-05T00:02:42.855ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
25132024-11-05T00:02:42.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25142024-11-05T00:02:42.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25152024-11-05T00:02:42.865ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25162024-11-05T00:02:42.866ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf5fff90-27aa-4685-b4ab-915adccf4a62", "content-length": "134", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
25172024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25182024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
25192024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25202024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25212024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25222024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25232024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25242024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25252024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25262024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25272024-11-05T00:02:42.866ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
25282024-11-05T00:02:42.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25292024-11-05T00:02:42.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25302024-11-05T00:02:42.868ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c946b0c-865a-4e86-9693-86cef67a9f2f", "content-length": "691", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
25312024-11-05T00:02:42.868ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
25322024-11-05T00:02:42.868ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
25332024-11-05T00:02:42.868ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
25342024-11-05T00:02:42.869ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25352024-11-05T00:02:42.869ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa7b3c8b-4406-48b4-8947-a6f31a145402", "content-length": "2", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
25362024-11-05T00:02:42.869ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25372024-11-05T00:02:42.869ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2994932-6f54-4246-9b00-145a9033a540", "content-length": "52", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
25382024-11-05T00:02:42.869ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
25392024-11-05T00:02:42.869ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25402024-11-05T00:02:42.870ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 698.929887ms iteration = 17 status = {}
25412024-11-05T00:02:42.970ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0cf6949f-5684-4cff-a51d-feb098ec6642", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
25422024-11-05T00:02:42.970ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
25432024-11-05T00:02:42.970ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25442024-11-05T00:02:42.970ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "14709111-f795-4878-a0c8-d05666349233", "content-length": "682", "date": "Tue, 05 Nov 2024 00:02:42 GMT"} })
25452024-11-05T00:02:42.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25462024-11-05T00:02:42.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25472024-11-05T00:02:42.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25482024-11-05T00:02:42.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25492024-11-05T00:02:42.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25502024-11-05T00:02:42.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25512024-11-05T00:02:42.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25522024-11-05T00:02:42.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25532024-11-05T00:02:42.994ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 823.254879ms iteration = 17 status = {}
25542024-11-05T00:02:43.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 63e87348-a563-44fc-9088-4bd33335b05b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25552024-11-05T00:02:43.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 63e87348-a563-44fc-9088-4bd33335b05b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25562024-11-05T00:02:43.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 63e87348-a563-44fc-9088-4bd33335b05b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25572024-11-05T00:02:44.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f6ef4a7c-6156-4933-95b4-acb35dbf5d81 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25582024-11-05T00:02:44.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f6ef4a7c-6156-4933-95b4-acb35dbf5d81 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25592024-11-05T00:02:44.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f6ef4a7c-6156-4933-95b4-acb35dbf5d81 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25602024-11-05T00:02:45.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8978200f-cb81-4add-988b-885eb93ca43c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25612024-11-05T00:02:45.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8978200f-cb81-4add-988b-885eb93ca43c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25622024-11-05T00:02:45.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8978200f-cb81-4add-988b-885eb93ca43c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25632024-11-05T00:02:46.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c28ab501-047e-420f-b69c-3bf50ad90dc4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25642024-11-05T00:02:46.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c28ab501-047e-420f-b69c-3bf50ad90dc4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25652024-11-05T00:02:46.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c28ab501-047e-420f-b69c-3bf50ad90dc4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25662024-11-05T00:02:47.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5e2e8664-8791-4e8a-b6f8-f9a37008b5de roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25672024-11-05T00:02:47.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5e2e8664-8791-4e8a-b6f8-f9a37008b5de resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25682024-11-05T00:02:47.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5e2e8664-8791-4e8a-b6f8-f9a37008b5de response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25692024-11-05T00:02:48.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4d07be0d-b62f-4d65-a7d6-820a94aa2ab8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25702024-11-05T00:02:48.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4d07be0d-b62f-4d65-a7d6-820a94aa2ab8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25712024-11-05T00:02:48.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4d07be0d-b62f-4d65-a7d6-820a94aa2ab8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25722024-11-05T00:02:49.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d2e31a2f-31c5-4135-aece-5ad28b6b668c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25732024-11-05T00:02:49.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d2e31a2f-31c5-4135-aece-5ad28b6b668c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25742024-11-05T00:02:49.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d2e31a2f-31c5-4135-aece-5ad28b6b668c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25752024-11-05T00:02:50.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6f6169ac-b3ef-4c4b-a5ad-c3e4d92cfdf1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25762024-11-05T00:02:50.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6f6169ac-b3ef-4c4b-a5ad-c3e4d92cfdf1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25772024-11-05T00:02:50.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6f6169ac-b3ef-4c4b-a5ad-c3e4d92cfdf1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25782024-11-05T00:02:51.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e53c38e3-18cd-43b8-b634-53a6f87565f8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25792024-11-05T00:02:51.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e53c38e3-18cd-43b8-b634-53a6f87565f8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25802024-11-05T00:02:51.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e53c38e3-18cd-43b8-b634-53a6f87565f8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25812024-11-05T00:02:51.878ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 450 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = f2e236e6-82ab-4ddd-b7eb-30c1b20ed0e5 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
25822024-11-05T00:02:52.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
25832024-11-05T00:02:52.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
25842024-11-05T00:02:52.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25852024-11-05T00:02:52.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25862024-11-05T00:02:52.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25872024-11-05T00:02:52.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25882024-11-05T00:02:52.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25892024-11-05T00:02:52.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25902024-11-05T00:02:52.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25912024-11-05T00:02:52.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25922024-11-05T00:02:52.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25932024-11-05T00:02:52.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25942024-11-05T00:02:52.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25952024-11-05T00:02:52.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
25962024-11-05T00:02:52.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25972024-11-05T00:02:52.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25982024-11-05T00:02:52.200ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25992024-11-05T00:02:52.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26002024-11-05T00:02:52.201ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
26012024-11-05T00:02:52.201ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.994636ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
26022024-11-05T00:02:52.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.97098ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26032024-11-05T00:02:52.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2f463166-0e14-47c8-91ba-083ab7e658c1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26042024-11-05T00:02:52.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2f463166-0e14-47c8-91ba-083ab7e658c1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26052024-11-05T00:02:52.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2f463166-0e14-47c8-91ba-083ab7e658c1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26062024-11-05T00:02:53.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 60e8c625-9f82-480c-8f4f-206d2e50f867 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26072024-11-05T00:02:53.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 60e8c625-9f82-480c-8f4f-206d2e50f867 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26082024-11-05T00:02:53.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 60e8c625-9f82-480c-8f4f-206d2e50f867 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26092024-11-05T00:02:54.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0a126c83-728f-4228-bb64-83d5a150b93b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26102024-11-05T00:02:54.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0a126c83-728f-4228-bb64-83d5a150b93b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26112024-11-05T00:02:54.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0a126c83-728f-4228-bb64-83d5a150b93b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26122024-11-05T00:02:55.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f688598f-bb8b-4e35-b125-9351ffd879be roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26132024-11-05T00:02:55.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f688598f-bb8b-4e35-b125-9351ffd879be resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26142024-11-05T00:02:55.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f688598f-bb8b-4e35-b125-9351ffd879be response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26152024-11-05T00:02:56.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d9af3e1-a2e8-474b-bc91-735a918a7f92 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26162024-11-05T00:02:56.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d9af3e1-a2e8-474b-bc91-735a918a7f92 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26172024-11-05T00:02:56.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9d9af3e1-a2e8-474b-bc91-735a918a7f92 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26182024-11-05T00:02:57.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0af253f8-097e-4eea-aa83-2aa6a29c08be roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26192024-11-05T00:02:57.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0af253f8-097e-4eea-aa83-2aa6a29c08be resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26202024-11-05T00:02:57.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0af253f8-097e-4eea-aa83-2aa6a29c08be response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26212024-11-05T00:02:58.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1784dc02-d65d-4daa-ae2c-46bba6c651f9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26222024-11-05T00:02:58.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1784dc02-d65d-4daa-ae2c-46bba6c651f9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26232024-11-05T00:02:58.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1784dc02-d65d-4daa-ae2c-46bba6c651f9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26242024-11-05T00:02:59.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7eb7a38c-1695-4dfd-ad7b-458564245dcd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26252024-11-05T00:02:59.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7eb7a38c-1695-4dfd-ad7b-458564245dcd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26262024-11-05T00:02:59.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7eb7a38c-1695-4dfd-ad7b-458564245dcd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26272024-11-05T00:03:00.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9c93cac2-ccf1-4f16-abf8-84ce86934429 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26282024-11-05T00:03:00.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9c93cac2-ccf1-4f16-abf8-84ce86934429 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26292024-11-05T00:03:00.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9c93cac2-ccf1-4f16-abf8-84ce86934429 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26302024-11-05T00:03:02.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2b8d46d-54ec-42a4-b79e-954fb1b44d20 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26312024-11-05T00:03:02.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2b8d46d-54ec-42a4-b79e-954fb1b44d20 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26322024-11-05T00:03:02.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2b8d46d-54ec-42a4-b79e-954fb1b44d20 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26332024-11-05T00:03:02.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
26342024-11-05T00:03:02.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
26352024-11-05T00:03:02.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26362024-11-05T00:03:02.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26372024-11-05T00:03:02.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26382024-11-05T00:03:02.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26392024-11-05T00:03:02.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26402024-11-05T00:03:02.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26412024-11-05T00:03:02.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26422024-11-05T00:03:02.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26432024-11-05T00:03:02.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26442024-11-05T00:03:02.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26452024-11-05T00:03:02.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26462024-11-05T00:03:02.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26472024-11-05T00:03:02.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26482024-11-05T00:03:02.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
26492024-11-05T00:03:02.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26502024-11-05T00:03:02.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26512024-11-05T00:03:02.193ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
26522024-11-05T00:03:02.193ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.531763ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
26532024-11-05T00:03:02.201ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.632659ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26542024-11-05T00:03:03.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 54dc9284-1eea-4d2a-91c1-41a859e462d7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26552024-11-05T00:03:03.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 54dc9284-1eea-4d2a-91c1-41a859e462d7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26562024-11-05T00:03:03.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 54dc9284-1eea-4d2a-91c1-41a859e462d7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26572024-11-05T00:03:04.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ba86943d-5027-4aec-ae9f-77e14b4c5240 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26582024-11-05T00:03:04.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ba86943d-5027-4aec-ae9f-77e14b4c5240 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26592024-11-05T00:03:04.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ba86943d-5027-4aec-ae9f-77e14b4c5240 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26602024-11-05T00:03:05.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7cc254b8-bb20-471e-88ca-674ecff29332 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26612024-11-05T00:03:05.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7cc254b8-bb20-471e-88ca-674ecff29332 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26622024-11-05T00:03:05.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7cc254b8-bb20-471e-88ca-674ecff29332 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26632024-11-05T00:03:06.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b614c442-1742-43d0-af2e-0ee7ff8da8c7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26642024-11-05T00:03:06.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b614c442-1742-43d0-af2e-0ee7ff8da8c7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26652024-11-05T00:03:06.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b614c442-1742-43d0-af2e-0ee7ff8da8c7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26662024-11-05T00:03:06.882ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 500 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 6f2abadf-b9c5-413a-8618-f34af5df9746 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
26672024-11-05T00:03:07.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 27497573-048a-4a10-a801-7df62c3df6e1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26682024-11-05T00:03:07.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 27497573-048a-4a10-a801-7df62c3df6e1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26692024-11-05T00:03:07.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 27497573-048a-4a10-a801-7df62c3df6e1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26702024-11-05T00:03:08.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f5130deb-e21f-446d-b160-b7edc03a89c2 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26712024-11-05T00:03:08.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f5130deb-e21f-446d-b160-b7edc03a89c2 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26722024-11-05T00:03:08.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f5130deb-e21f-446d-b160-b7edc03a89c2 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26732024-11-05T00:03:09.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fb772901-1a40-489c-9d35-578071de02ac roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26742024-11-05T00:03:09.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fb772901-1a40-489c-9d35-578071de02ac resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26752024-11-05T00:03:09.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fb772901-1a40-489c-9d35-578071de02ac response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26762024-11-05T00:03:10.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b9fec940-be59-45f8-b8d3-4567e234674f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26772024-11-05T00:03:10.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b9fec940-be59-45f8-b8d3-4567e234674f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26782024-11-05T00:03:10.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b9fec940-be59-45f8-b8d3-4567e234674f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26792024-11-05T00:03:11.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8a0a768b-fb5e-4481-a63a-c3383151554b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26802024-11-05T00:03:11.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8a0a768b-fb5e-4481-a63a-c3383151554b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26812024-11-05T00:03:11.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8a0a768b-fb5e-4481-a63a-c3383151554b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26822024-11-05T00:03:12.171ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
26832024-11-05T00:03:12.171ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
26842024-11-05T00:03:12.171ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26852024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26862024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
26872024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
26882024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26892024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
26902024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
26912024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26922024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26932024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
26942024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26952024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26962024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
26972024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
26982024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26992024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27002024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
27012024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27022024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
27032024-11-05T00:03:12.172ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27042024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
27052024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27062024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27072024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
27082024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27092024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
27102024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.77\u{b5}s iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
27112024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
27122024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
27132024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.06\u{b5}s iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27142024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.92\u{b5}s iteration = 18 status = {"errors":[],"records_set_to_done":[]}
27152024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
27162024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.169\u{b5}s iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27172024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27182024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27192024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27202024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27212024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27222024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27232024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27242024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27252024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27262024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27272024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27282024-11-05T00:03:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27292024-11-05T00:03:12.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27302024-11-05T00:03:12.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27312024-11-05T00:03:12.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27322024-11-05T00:03:12.175ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.788528ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27332024-11-05T00:03:12.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2835, tv_nsec: 763396456 } })
27342024-11-05T00:03:12.176ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
27352024-11-05T00:03:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27362024-11-05T00:03:12.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27372024-11-05T00:03:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27382024-11-05T00:03:12.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27392024-11-05T00:03:12.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27402024-11-05T00:03:12.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27412024-11-05T00:03:12.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27422024-11-05T00:03:12.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27432024-11-05T00:03:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27442024-11-05T00:03:12.180ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27452024-11-05T00:03:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27462024-11-05T00:03:12.180ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2835, tv_nsec: 768023501 } })
27472024-11-05T00:03:12.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27482024-11-05T00:03:12.181ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
27492024-11-05T00:03:12.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27502024-11-05T00:03:12.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27512024-11-05T00:03:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27522024-11-05T00:03:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27532024-11-05T00:03:12.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27542024-11-05T00:03:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27552024-11-05T00:03:12.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27562024-11-05T00:03:12.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27572024-11-05T00:03:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27582024-11-05T00:03:12.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27592024-11-05T00:03:12.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27602024-11-05T00:03:12.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27612024-11-05T00:03:12.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
27622024-11-05T00:03:12.188ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27632024-11-05T00:03:12.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27642024-11-05T00:03:12.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27652024-11-05T00:03:12.196ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2835, tv_nsec: 784114681 } })
27662024-11-05T00:03:12.197ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27672024-11-05T00:03:12.197ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27682024-11-05T00:03:12.197ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
27692024-11-05T00:03:12.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27702024-11-05T00:03:12.208ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
27712024-11-05T00:03:12.208ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.872966ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
27722024-11-05T00:03:12.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27732024-11-05T00:03:12.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27742024-11-05T00:03:12.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27752024-11-05T00:03:12.225ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27762024-11-05T00:03:12.225ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27772024-11-05T00:03:12.225ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27782024-11-05T00:03:12.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27792024-11-05T00:03:12.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27802024-11-05T00:03:12.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27812024-11-05T00:03:12.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27822024-11-05T00:03:12.228ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27832024-11-05T00:03:12.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27842024-11-05T00:03:12.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27852024-11-05T00:03:12.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27862024-11-05T00:03:12.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27872024-11-05T00:03:12.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.556412ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27882024-11-05T00:03:12.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27892024-11-05T00:03:12.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27902024-11-05T00:03:12.234ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27912024-11-05T00:03:12.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b4e52462-9654-466e-b78e-3e9f591afb45 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27922024-11-05T00:03:12.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27932024-11-05T00:03:12.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b4e52462-9654-466e-b78e-3e9f591afb45 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27942024-11-05T00:03:12.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27952024-11-05T00:03:12.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27962024-11-05T00:03:12.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b4e52462-9654-466e-b78e-3e9f591afb45 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27972024-11-05T00:03:12.237ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27982024-11-05T00:03:12.237ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.806101ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27992024-11-05T00:03:12.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
28002024-11-05T00:03:12.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28012024-11-05T00:03:12.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28022024-11-05T00:03:12.241ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.004428ms iteration = 18 status = 0
28032024-11-05T00:03:12.267ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.764885ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28042024-11-05T00:03:12.274ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28052024-11-05T00:03:12.274ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28062024-11-05T00:03:12.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28072024-11-05T00:03:12.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28082024-11-05T00:03:12.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
28092024-11-05T00:03:12.282ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28102024-11-05T00:03:12.282ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3693e2cf-a3e6-4a0f-b7f1-6167ae028f6e", "content-length": "26", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28112024-11-05T00:03:12.282ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28122024-11-05T00:03:12.286ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28132024-11-05T00:03:12.312ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28142024-11-05T00:03:12.312ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28152024-11-05T00:03:12.312ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.673937ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28162024-11-05T00:03:12.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28172024-11-05T00:03:12.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28182024-11-05T00:03:12.349ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 177.821949ms iteration = 20 status = {"physical_disks_added":0}
28192024-11-05T00:03:12.351ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
28202024-11-05T00:03:12.351ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28212024-11-05T00:03:12.351ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b28e74fe-ecce-404f-a53b-db4e112816f8", "content-length": "26", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28222024-11-05T00:03:12.351ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28232024-11-05T00:03:12.353ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28242024-11-05T00:03:12.388ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
28252024-11-05T00:03:12.388ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28262024-11-05T00:03:12.388ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9bb50e8-4d75-4b59-93c1-0013491446aa", "content-length": "26", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28272024-11-05T00:03:12.388ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28282024-11-05T00:03:12.390ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
28292024-11-05T00:03:12.395ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28302024-11-05T00:03:12.395ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28312024-11-05T00:03:12.395ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "46e24d35-c0ee-4795-a054-f3f38aad51ea", "content-length": "372", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28322024-11-05T00:03:12.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28332024-11-05T00:03:12.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28342024-11-05T00:03:12.412ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28352024-11-05T00:03:12.412ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28362024-11-05T00:03:12.412ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "683dddfd-1ec9-4397-9b4d-c33cf8ab4abe", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28372024-11-05T00:03:12.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28382024-11-05T00:03:12.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28392024-11-05T00:03:12.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28402024-11-05T00:03:12.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28412024-11-05T00:03:12.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28422024-11-05T00:03:12.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28432024-11-05T00:03:12.421ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28442024-11-05T00:03:12.421ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28452024-11-05T00:03:12.421ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7e9fc156-4392-462a-a273-8e4e1b1d8b46", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28462024-11-05T00:03:12.423ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 251.473812ms iteration = 18 status = {}
28472024-11-05T00:03:12.467ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 295.792591ms iteration = 18 status = {}
28482024-11-05T00:03:12.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28492024-11-05T00:03:12.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28502024-11-05T00:03:12.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28512024-11-05T00:03:12.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28522024-11-05T00:03:12.514ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28532024-11-05T00:03:12.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28542024-11-05T00:03:12.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28552024-11-05T00:03:12.518ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28562024-11-05T00:03:12.518ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28572024-11-05T00:03:12.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28582024-11-05T00:03:12.527ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28592024-11-05T00:03:12.527ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f691717-69bf-450e-a30b-e503c8b81fd7", "content-length": "1", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28602024-11-05T00:03:12.529ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28612024-11-05T00:03:12.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28622024-11-05T00:03:12.531ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 359.626242ms iteration = 18 status = null
28632024-11-05T00:03:12.642ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28642024-11-05T00:03:12.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28652024-11-05T00:03:12.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28662024-11-05T00:03:12.649ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
28672024-11-05T00:03:12.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28682024-11-05T00:03:12.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28692024-11-05T00:03:12.660ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28702024-11-05T00:03:12.660ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "523262f8-df57-4412-9041-f116a1b00714", "content-length": "134", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28712024-11-05T00:03:12.660ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28722024-11-05T00:03:12.660ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
28732024-11-05T00:03:12.660ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28742024-11-05T00:03:12.660ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28752024-11-05T00:03:12.660ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28762024-11-05T00:03:12.660ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28772024-11-05T00:03:12.660ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28782024-11-05T00:03:12.660ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28792024-11-05T00:03:12.661ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28802024-11-05T00:03:12.661ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28812024-11-05T00:03:12.661ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
28822024-11-05T00:03:12.661ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28832024-11-05T00:03:12.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28842024-11-05T00:03:12.664ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28852024-11-05T00:03:12.664ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ae50d60-8d0f-4405-82d4-3df26787cc1f", "content-length": "2", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28862024-11-05T00:03:12.664ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28872024-11-05T00:03:12.664ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fa0ca30-9542-434f-948f-262a180ac615", "content-length": "52", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28882024-11-05T00:03:12.664ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
28892024-11-05T00:03:12.664ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28902024-11-05T00:03:12.678ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "17781687-2dbd-496d-a726-a9c48e5bc777", "content-length": "691", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28912024-11-05T00:03:12.678ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28922024-11-05T00:03:12.678ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28932024-11-05T00:03:12.678ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28942024-11-05T00:03:12.680ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 508.506748ms iteration = 18 status = {}
28952024-11-05T00:03:12.779ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6aa4cba6-75c0-4d1e-8f30-ff13d256253d", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28962024-11-05T00:03:12.779ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
28972024-11-05T00:03:12.779ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28982024-11-05T00:03:12.779ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f69dc78d-8233-4d37-ad0c-98b44a7e6a9d", "content-length": "682", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
28992024-11-05T00:03:12.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29002024-11-05T00:03:12.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29012024-11-05T00:03:12.783ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29022024-11-05T00:03:12.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29032024-11-05T00:03:12.787ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29042024-11-05T00:03:12.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29052024-11-05T00:03:12.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29062024-11-05T00:03:12.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29072024-11-05T00:03:12.796ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 624.665443ms iteration = 18 status = {}
29082024-11-05T00:03:12.812ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
29092024-11-05T00:03:12.812ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
29102024-11-05T00:03:12.843ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
29112024-11-05T00:03:12.844ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36274
29122024-11-05T00:03:12.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36274 req_id = 3460dc58-e925-4fb9-bd2f-5138de35180c roles = RoleSet { roles: {} } uri = /metrics/producers
29132024-11-05T00:03:12.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36274 req_id = 3460dc58-e925-4fb9-bd2f-5138de35180c resource = Database result = Ok(()) uri = /metrics/producers
29142024-11-05T00:03:12.884ZINFOnexus: assigned collector to new producer collector_id = 936f0bc7-d5c8-4edc-b21c-cc06e01960a5 file = nexus/src/app/oximeter.rs:76 producer_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
29152024-11-05T00:03:12.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40177 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36274 req_id = 3460dc58-e925-4fb9-bd2f-5138de35180c response_code = 201 uri = /metrics/producers
29162024-11-05T00:03:12.884ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3460dc58-e925-4fb9-bd2f-5138de35180c", "content-length": "41", "date": "Tue, 05 Nov 2024 00:03:12 GMT"} })
29172024-11-05T00:03:12.886ZDEBGnexus (producer-registration-task): registered with nexus successfully
29182024-11-05T00:03:12.886ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
29192024-11-05T00:03:13.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ea627b8f-fcb6-42fb-baa1-cd8518ce53bb roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29202024-11-05T00:03:13.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ea627b8f-fcb6-42fb-baa1-cd8518ce53bb resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29212024-11-05T00:03:13.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ea627b8f-fcb6-42fb-baa1-cd8518ce53bb response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29222024-11-05T00:03:14.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9109ea1e-138a-46f9-9777-b18b5cf876ba roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29232024-11-05T00:03:14.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9109ea1e-138a-46f9-9777-b18b5cf876ba resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29242024-11-05T00:03:14.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9109ea1e-138a-46f9-9777-b18b5cf876ba response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29252024-11-05T00:03:15.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d2ba94b-e11f-4b39-ac05-1f29760579d7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29262024-11-05T00:03:15.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d2ba94b-e11f-4b39-ac05-1f29760579d7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29272024-11-05T00:03:15.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d2ba94b-e11f-4b39-ac05-1f29760579d7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29282024-11-05T00:03:16.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d244f4a2-7998-425d-a8e9-eb4ac700091a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29292024-11-05T00:03:16.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d244f4a2-7998-425d-a8e9-eb4ac700091a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29302024-11-05T00:03:16.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d244f4a2-7998-425d-a8e9-eb4ac700091a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29312024-11-05T00:03:17.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 17deb04c-ff0e-4c6f-a03c-2e66d3773cae roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29322024-11-05T00:03:17.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 17deb04c-ff0e-4c6f-a03c-2e66d3773cae resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29332024-11-05T00:03:17.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 17deb04c-ff0e-4c6f-a03c-2e66d3773cae response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29342024-11-05T00:03:18.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = eabf904e-38e2-4e4e-b9a2-8866fe3d62ef roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29352024-11-05T00:03:18.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = eabf904e-38e2-4e4e-b9a2-8866fe3d62ef resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29362024-11-05T00:03:18.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = eabf904e-38e2-4e4e-b9a2-8866fe3d62ef response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29372024-11-05T00:03:19.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0791df30-e758-45ec-93e5-dc97ae543f3b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29382024-11-05T00:03:19.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0791df30-e758-45ec-93e5-dc97ae543f3b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29392024-11-05T00:03:19.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0791df30-e758-45ec-93e5-dc97ae543f3b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29402024-11-05T00:03:20.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a31a98ed-257f-4a9d-94ff-153bc1a67624 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29412024-11-05T00:03:20.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a31a98ed-257f-4a9d-94ff-153bc1a67624 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29422024-11-05T00:03:20.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a31a98ed-257f-4a9d-94ff-153bc1a67624 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29432024-11-05T00:03:21.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bc92f121-4982-4da3-897c-7dfaab3e5d29 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29442024-11-05T00:03:21.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bc92f121-4982-4da3-897c-7dfaab3e5d29 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29452024-11-05T00:03:21.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bc92f121-4982-4da3-897c-7dfaab3e5d29 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29462024-11-05T00:03:21.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 423 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = deae7bc3-06ae-4523-8283-0689131e051e response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
29472024-11-05T00:03:22.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
29482024-11-05T00:03:22.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
29492024-11-05T00:03:22.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29502024-11-05T00:03:22.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29512024-11-05T00:03:22.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29522024-11-05T00:03:22.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29532024-11-05T00:03:22.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29542024-11-05T00:03:22.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29552024-11-05T00:03:22.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29562024-11-05T00:03:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29572024-11-05T00:03:22.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29582024-11-05T00:03:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29592024-11-05T00:03:22.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29602024-11-05T00:03:22.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29612024-11-05T00:03:22.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29622024-11-05T00:03:22.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
29632024-11-05T00:03:22.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29642024-11-05T00:03:22.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29652024-11-05T00:03:22.202ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
29662024-11-05T00:03:22.202ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.235271ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
29672024-11-05T00:03:22.216ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.065954ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29682024-11-05T00:03:22.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b2f64ed9-7093-41e3-b0eb-5f40c59472ee roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29692024-11-05T00:03:22.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b2f64ed9-7093-41e3-b0eb-5f40c59472ee resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29702024-11-05T00:03:22.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b2f64ed9-7093-41e3-b0eb-5f40c59472ee response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29712024-11-05T00:03:23.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b6d4389e-a74a-460b-9e82-598e185b4f79 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29722024-11-05T00:03:23.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b6d4389e-a74a-460b-9e82-598e185b4f79 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29732024-11-05T00:03:23.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b6d4389e-a74a-460b-9e82-598e185b4f79 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29742024-11-05T00:03:24.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8e4b5986-26f6-4e44-b828-4c7f82057670 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29752024-11-05T00:03:24.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8e4b5986-26f6-4e44-b828-4c7f82057670 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29762024-11-05T00:03:24.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8e4b5986-26f6-4e44-b828-4c7f82057670 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29772024-11-05T00:03:25.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 06cd5a20-5065-4a19-a9f6-40b7b1135f96 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29782024-11-05T00:03:25.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 06cd5a20-5065-4a19-a9f6-40b7b1135f96 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29792024-11-05T00:03:25.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 06cd5a20-5065-4a19-a9f6-40b7b1135f96 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29802024-11-05T00:03:26.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0d81a414-9150-4061-8508-cb3e8c5aece3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29812024-11-05T00:03:26.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0d81a414-9150-4061-8508-cb3e8c5aece3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29822024-11-05T00:03:26.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0d81a414-9150-4061-8508-cb3e8c5aece3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29832024-11-05T00:03:26.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 80b930e7-915b-4912-8de9-c542cc63e122 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
29842024-11-05T00:03:26.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 80b930e7-915b-4912-8de9-c542cc63e122 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
29852024-11-05T00:03:26.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 80b930e7-915b-4912-8de9-c542cc63e122 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
29862024-11-05T00:03:26.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = c64ab8bc-88d9-4671-a76d-93a4ba581f42 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
29872024-11-05T00:03:26.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = c64ab8bc-88d9-4671-a76d-93a4ba581f42 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
29882024-11-05T00:03:26.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = c64ab8bc-88d9-4671-a76d-93a4ba581f42 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
29892024-11-05T00:03:27.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 12610840-335b-45a0-a00e-7e335001c018 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29902024-11-05T00:03:27.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 12610840-335b-45a0-a00e-7e335001c018 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29912024-11-05T00:03:27.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 12610840-335b-45a0-a00e-7e335001c018 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29922024-11-05T00:03:28.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dcab5df8-d681-4487-ae79-7788c63174dd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29932024-11-05T00:03:28.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dcab5df8-d681-4487-ae79-7788c63174dd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29942024-11-05T00:03:28.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dcab5df8-d681-4487-ae79-7788c63174dd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29952024-11-05T00:03:29.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6f0bc2b2-487f-41a7-8859-c18e472bd063 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29962024-11-05T00:03:29.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6f0bc2b2-487f-41a7-8859-c18e472bd063 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29972024-11-05T00:03:29.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6f0bc2b2-487f-41a7-8859-c18e472bd063 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29982024-11-05T00:03:30.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = efe54dcb-866d-4ab5-9803-252ccb24cc4b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29992024-11-05T00:03:30.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = efe54dcb-866d-4ab5-9803-252ccb24cc4b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30002024-11-05T00:03:30.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = efe54dcb-866d-4ab5-9803-252ccb24cc4b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30012024-11-05T00:03:31.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e3aeb14f-4ea2-48e4-9443-53ba06466591 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30022024-11-05T00:03:31.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e3aeb14f-4ea2-48e4-9443-53ba06466591 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30032024-11-05T00:03:31.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e3aeb14f-4ea2-48e4-9443-53ba06466591 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30042024-11-05T00:03:32.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
30052024-11-05T00:03:32.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
30062024-11-05T00:03:32.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30072024-11-05T00:03:32.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30082024-11-05T00:03:32.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30092024-11-05T00:03:32.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30102024-11-05T00:03:32.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30112024-11-05T00:03:32.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30122024-11-05T00:03:32.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30132024-11-05T00:03:32.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.524002ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30142024-11-05T00:03:32.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30152024-11-05T00:03:32.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30162024-11-05T00:03:32.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30172024-11-05T00:03:32.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30182024-11-05T00:03:32.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30192024-11-05T00:03:32.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30202024-11-05T00:03:32.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
30212024-11-05T00:03:32.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30222024-11-05T00:03:32.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30232024-11-05T00:03:32.195ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
30242024-11-05T00:03:32.195ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.270368ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
30252024-11-05T00:03:32.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d9861b1-e9eb-46eb-9e63-60f1c8510212 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30262024-11-05T00:03:32.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d9861b1-e9eb-46eb-9e63-60f1c8510212 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30272024-11-05T00:03:32.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d9861b1-e9eb-46eb-9e63-60f1c8510212 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30282024-11-05T00:03:33.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7c06c3ed-af3e-49ba-875d-5b752fe6627d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30292024-11-05T00:03:33.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7c06c3ed-af3e-49ba-875d-5b752fe6627d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30302024-11-05T00:03:33.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1907 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7c06c3ed-af3e-49ba-875d-5b752fe6627d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30312024-11-05T00:03:34.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1babef16-4b16-469c-9aa5-b4ac4e4168e2 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30322024-11-05T00:03:34.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1babef16-4b16-469c-9aa5-b4ac4e4168e2 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30332024-11-05T00:03:34.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1babef16-4b16-469c-9aa5-b4ac4e4168e2 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30342024-11-05T00:03:35.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b595de63-d4ee-4a00-bad9-6a86cbf859e3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30352024-11-05T00:03:35.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b595de63-d4ee-4a00-bad9-6a86cbf859e3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30362024-11-05T00:03:35.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b595de63-d4ee-4a00-bad9-6a86cbf859e3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30372024-11-05T00:03:36.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4172242e-f5f0-4137-b370-31227d9d4c6b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30382024-11-05T00:03:36.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4172242e-f5f0-4137-b370-31227d9d4c6b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30392024-11-05T00:03:36.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4172242e-f5f0-4137-b370-31227d9d4c6b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30402024-11-05T00:03:36.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 522 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = d46b8ffa-96a3-4f5d-b843-ce22ed02cdd7 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
30412024-11-05T00:03:37.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4c65f476-4808-4076-8b10-a1a7b62ad371 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30422024-11-05T00:03:37.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4c65f476-4808-4076-8b10-a1a7b62ad371 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30432024-11-05T00:03:37.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4c65f476-4808-4076-8b10-a1a7b62ad371 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30442024-11-05T00:03:38.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 640f8f4d-9188-43cf-8a97-1fe177903a74 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30452024-11-05T00:03:38.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 640f8f4d-9188-43cf-8a97-1fe177903a74 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30462024-11-05T00:03:38.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 640f8f4d-9188-43cf-8a97-1fe177903a74 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30472024-11-05T00:03:39.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 577983de-b7ba-44b3-b7d7-4efd04ac211e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30482024-11-05T00:03:39.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 577983de-b7ba-44b3-b7d7-4efd04ac211e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30492024-11-05T00:03:39.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 577983de-b7ba-44b3-b7d7-4efd04ac211e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30502024-11-05T00:03:40.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = aa9e3f68-ac52-41d4-b04f-66a9a4f946d5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30512024-11-05T00:03:40.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = aa9e3f68-ac52-41d4-b04f-66a9a4f946d5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30522024-11-05T00:03:40.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = aa9e3f68-ac52-41d4-b04f-66a9a4f946d5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30532024-11-05T00:03:41.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = e51b9b1f-f0df-4af8-a78a-57f9b0419727 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
30542024-11-05T00:03:41.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = e51b9b1f-f0df-4af8-a78a-57f9b0419727 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
30552024-11-05T00:03:41.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = e51b9b1f-f0df-4af8-a78a-57f9b0419727 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
30562024-11-05T00:03:41.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = cbe4dc87-07d5-4ad5-8d6a-18a4aa9767ad roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
30572024-11-05T00:03:41.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = cbe4dc87-07d5-4ad5-8d6a-18a4aa9767ad resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
30582024-11-05T00:03:41.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = cbe4dc87-07d5-4ad5-8d6a-18a4aa9767ad response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
30592024-11-05T00:03:41.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 258f8e56-2307-4a03-99a0-474ab715a904 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30602024-11-05T00:03:41.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 258f8e56-2307-4a03-99a0-474ab715a904 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30612024-11-05T00:03:41.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 258f8e56-2307-4a03-99a0-474ab715a904 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30622024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
30632024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30642024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
30652024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
30662024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30672024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30682024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
30692024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
30702024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
30712024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30722024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
30732024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
30742024-11-05T00:03:42.171ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-04 23:53:42.171441588 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30752024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30762024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
30772024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
30782024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30792024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
30802024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30812024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30822024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30832024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
30842024-11-05T00:03:42.171ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970
30852024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
30862024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.11\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970"}
30872024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30882024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30892024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
30902024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
30912024-11-05T00:03:42.171ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30922024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30932024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
30942024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30952024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30962024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30972024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
30982024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
30992024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31002024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
31012024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31022024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
31032024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31042024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
31052024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31062024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
31072024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31082024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
31092024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
31102024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
31112024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31122024-11-05T00:03:42.171ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31132024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31142024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31152024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31162024-11-05T00:03:42.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31172024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31182024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31192024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31202024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31212024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31222024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
31232024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
31242024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31252024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
31262024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.75\u{b5}s iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
31272024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31282024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
31292024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
31302024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31312024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.1\u{b5}s iteration = 19 status = {"errors":[],"records_set_to_done":[]}
31322024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
31332024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31342024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31352024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31362024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.511\u{b5}s iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31372024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.141\u{b5}s iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31382024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31392024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31402024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31412024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31422024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31432024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31442024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31452024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31462024-11-05T00:03:42.172ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f4c9dd5-dad6-4fc2-ba58-b064adbea295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2865, tv_nsec: 759234881 } })
31472024-11-05T00:03:42.172ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("08f058bf-bffa-4561-8799-2d5d32641d33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e5a3f00-3f5b-4cac-8aa4-99515a0afee2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2865, tv_nsec: 759230910 } })
31482024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31492024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31502024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31512024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31522024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31532024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31542024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31552024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31562024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31572024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
31582024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.46572ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
31592024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
31602024-11-05T00:03:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.340487ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
31612024-11-05T00:03:42.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31622024-11-05T00:03:42.174ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-04 23:53:42.171441588 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
31632024-11-05T00:03:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.096474ms iteration = 10 status = {"expiration":"2024-11-04T23:53:42.171441588Z","pruned":[]}
31642024-11-05T00:03:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.345228ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31652024-11-05T00:03:42.175ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2865, tv_nsec: 762012278 } })
31662024-11-05T00:03:42.175ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
31672024-11-05T00:03:42.175ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31682024-11-05T00:03:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31692024-11-05T00:03:42.175ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31702024-11-05T00:03:42.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31712024-11-05T00:03:42.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31722024-11-05T00:03:42.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31732024-11-05T00:03:42.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31742024-11-05T00:03:42.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31752024-11-05T00:03:42.177ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31762024-11-05T00:03:42.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31772024-11-05T00:03:42.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31782024-11-05T00:03:42.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31792024-11-05T00:03:42.178ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31802024-11-05T00:03:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31812024-11-05T00:03:42.179ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31822024-11-05T00:03:42.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31832024-11-05T00:03:42.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31842024-11-05T00:03:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31852024-11-05T00:03:42.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31862024-11-05T00:03:42.181ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31872024-11-05T00:03:42.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31882024-11-05T00:03:42.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31892024-11-05T00:03:42.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31902024-11-05T00:03:42.182ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31912024-11-05T00:03:42.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31922024-11-05T00:03:42.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31932024-11-05T00:03:42.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31942024-11-05T00:03:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31952024-11-05T00:03:42.184ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31962024-11-05T00:03:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31972024-11-05T00:03:42.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31982024-11-05T00:03:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31992024-11-05T00:03:42.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32002024-11-05T00:03:42.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2865, tv_nsec: 774439423 } })
32012024-11-05T00:03:42.187ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32022024-11-05T00:03:42.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
32032024-11-05T00:03:42.188ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.55899ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
32042024-11-05T00:03:42.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32052024-11-05T00:03:42.189ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32062024-11-05T00:03:42.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32072024-11-05T00:03:42.189ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082024-11-05T00:03:42.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32092024-11-05T00:03:42.191ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32102024-11-05T00:03:42.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32112024-11-05T00:03:42.192ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32122024-11-05T00:03:42.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32132024-11-05T00:03:42.194ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32142024-11-05T00:03:42.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32152024-11-05T00:03:42.194ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32162024-11-05T00:03:42.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32172024-11-05T00:03:42.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32182024-11-05T00:03:42.196ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32192024-11-05T00:03:42.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32202024-11-05T00:03:42.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32212024-11-05T00:03:42.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32222024-11-05T00:03:42.201ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.277322ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32232024-11-05T00:03:42.203ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32242024-11-05T00:03:42.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32252024-11-05T00:03:42.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32262024-11-05T00:03:42.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32272024-11-05T00:03:42.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32282024-11-05T00:03:42.204ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2865, tv_nsec: 791509783 } })
32292024-11-05T00:03:42.204ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
32302024-11-05T00:03:42.206ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32312024-11-05T00:03:42.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32322024-11-05T00:03:42.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32332024-11-05T00:03:42.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32342024-11-05T00:03:42.208ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 37.524851ms iteration = 5 status = {"nsuccess":5}
32352024-11-05T00:03:42.209ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32362024-11-05T00:03:42.210ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32372024-11-05T00:03:42.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32382024-11-05T00:03:42.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32392024-11-05T00:03:42.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32402024-11-05T00:03:42.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32412024-11-05T00:03:42.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32422024-11-05T00:03:42.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32432024-11-05T00:03:42.231ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32442024-11-05T00:03:42.231ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32452024-11-05T00:03:42.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32462024-11-05T00:03:42.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32472024-11-05T00:03:42.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32482024-11-05T00:03:42.240ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32492024-11-05T00:03:42.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32502024-11-05T00:03:42.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32512024-11-05T00:03:42.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32522024-11-05T00:03:42.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32532024-11-05T00:03:42.244ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32542024-11-05T00:03:42.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32552024-11-05T00:03:42.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32562024-11-05T00:03:42.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32572024-11-05T00:03:42.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32582024-11-05T00:03:42.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32592024-11-05T00:03:42.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32602024-11-05T00:03:42.249ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
32612024-11-05T00:03:42.249ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
32622024-11-05T00:03:42.249ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.858487ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
32632024-11-05T00:03:42.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32642024-11-05T00:03:42.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32652024-11-05T00:03:42.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
32662024-11-05T00:03:42.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32672024-11-05T00:03:42.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32682024-11-05T00:03:42.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32692024-11-05T00:03:42.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32702024-11-05T00:03:42.259ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32712024-11-05T00:03:42.259ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.797621ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32722024-11-05T00:03:42.259ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32732024-11-05T00:03:42.259ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32742024-11-05T00:03:42.259ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32752024-11-05T00:03:42.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32762024-11-05T00:03:42.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32772024-11-05T00:03:42.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32782024-11-05T00:03:42.262ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32792024-11-05T00:03:42.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32802024-11-05T00:03:42.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32812024-11-05T00:03:42.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32822024-11-05T00:03:42.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32832024-11-05T00:03:42.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32842024-11-05T00:03:42.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32852024-11-05T00:03:42.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
32862024-11-05T00:03:42.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.301756ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
32872024-11-05T00:03:42.270ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32882024-11-05T00:03:42.270ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 0 version = 2
32892024-11-05T00:03:42.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32902024-11-05T00:03:42.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32912024-11-05T00:03:42.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32922024-11-05T00:03:42.273ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32932024-11-05T00:03:42.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32942024-11-05T00:03:42.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32952024-11-05T00:03:42.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32962024-11-05T00:03:42.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32972024-11-05T00:03:42.281ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32982024-11-05T00:03:42.282ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 1 version = 2
32992024-11-05T00:03:42.282ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33002024-11-05T00:03:42.282ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-04 23:54:45.073528 UTC dns_group = external generation = 2
33012024-11-05T00:03:42.282ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 110.820974ms iteration = 10 status = {"generation":2}
33022024-11-05T00:03:42.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33032024-11-05T00:03:42.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33042024-11-05T00:03:42.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33052024-11-05T00:03:42.286ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33062024-11-05T00:03:42.286ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33072024-11-05T00:03:42.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33082024-11-05T00:03:42.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33092024-11-05T00:03:42.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33102024-11-05T00:03:42.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
33112024-11-05T00:03:42.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33122024-11-05T00:03:42.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33132024-11-05T00:03:42.302ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 130.360595ms iteration = 19 status = 0
33142024-11-05T00:03:42.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 137.757927ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33152024-11-05T00:03:42.313ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33162024-11-05T00:03:42.313ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33172024-11-05T00:03:42.313ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 141.468084ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33182024-11-05T00:03:42.317ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33192024-11-05T00:03:42.325ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33202024-11-05T00:03:42.325ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33212024-11-05T00:03:42.325ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33222024-11-05T00:03:42.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33232024-11-05T00:03:42.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33242024-11-05T00:03:42.326ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
33252024-11-05T00:03:42.326ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33262024-11-05T00:03:42.326ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3f4a22b-03a3-43f0-87c8-6314f5733467", "content-length": "26", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} })
33272024-11-05T00:03:42.326ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33282024-11-05T00:03:42.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33292024-11-05T00:03:42.328ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33302024-11-05T00:03:42.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33312024-11-05T00:03:42.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33322024-11-05T00:03:42.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33332024-11-05T00:03:42.331ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33342024-11-05T00:03:42.331ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33352024-11-05T00:03:42.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33362024-11-05T00:03:42.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33372024-11-05T00:03:42.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33382024-11-05T00:03:42.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33392024-11-05T00:03:42.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33402024-11-05T00:03:42.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33412024-11-05T00:03:42.339ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33422024-11-05T00:03:42.341ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33432024-11-05T00:03:42.341ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33442024-11-05T00:03:42.341ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-04 23:54:43.769339 UTC dns_group = internal generation = 1
33452024-11-05T00:03:42.341ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 168.874606ms iteration = 10 status = {"generation":1}
33462024-11-05T00:03:42.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33472024-11-05T00:03:42.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33482024-11-05T00:03:42.345ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33492024-11-05T00:03:42.345ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33502024-11-05T00:03:42.345ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 173.92941ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33512024-11-05T00:03:42.352ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
33522024-11-05T00:03:42.352ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33532024-11-05T00:03:42.353ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fed7fa00-575e-4859-9a48-9fd878ba93fe", "content-length": "26", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} })
33542024-11-05T00:03:42.353ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33552024-11-05T00:03:42.354ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
33562024-11-05T00:03:42.358ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
33572024-11-05T00:03:42.358ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 186.829115ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33582024-11-05T00:03:42.358ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-04T23:54:39.943212Z, time_modified: 2024-11-04T23:54:39.943212Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }) }
33592024-11-05T00:03:42.358ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 187.039719ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]}},"default_endpoint":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33602024-11-05T00:03:42.376ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
33612024-11-05T00:03:42.376ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33622024-11-05T00:03:42.376ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "098fbea1-708b-409b-ba98-d6c3127fc72e", "content-length": "26", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} })
33632024-11-05T00:03:42.376ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33642024-11-05T00:03:42.378ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33652024-11-05T00:03:42.379ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 208.324186ms iteration = 21 status = {"physical_disks_added":0}
33662024-11-05T00:03:42.394ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33672024-11-05T00:03:42.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33682024-11-05T00:03:42.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33692024-11-05T00:03:42.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33702024-11-05T00:03:42.398ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33712024-11-05T00:03:42.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33722024-11-05T00:03:42.400ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33732024-11-05T00:03:42.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33742024-11-05T00:03:42.402ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33752024-11-05T00:03:42.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33762024-11-05T00:03:42.487ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33772024-11-05T00:03:42.488ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9d24b67b-ab27-4a6d-9941-0311b4782fc8", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33782024-11-05T00:03:42.488ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33792024-11-05T00:03:42.489ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f5fd2fd2-5035-4636-9e99-ca67635208dc", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33802024-11-05T00:03:42.489ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33812024-11-05T00:03:42.491ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33822024-11-05T00:03:42.491ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 320.166292ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33832024-11-05T00:03:42.518ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33842024-11-05T00:03:42.518ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0e2fadd-5ef9-4031-80af-7ff77d1dcc60", "content-length": "1", "date": "Tue, 05 Nov 2024 00:03:41 GMT"} })
33852024-11-05T00:03:42.520ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33862024-11-05T00:03:42.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33872024-11-05T00:03:42.539ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33882024-11-05T00:03:42.539ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33892024-11-05T00:03:42.539ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33902024-11-05T00:03:42.540ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "213bf557-1b33-4f94-945e-ccd4b841271c", "content-length": "372", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} })
33912024-11-05T00:03:42.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33922024-11-05T00:03:42.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33932024-11-05T00:03:42.541ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 370.371993ms iteration = 19 status = null
33942024-11-05T00:03:42.576ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33952024-11-05T00:03:42.577ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "21c00d44-5d1c-40c3-b5e7-4f185d35e4a8", "content-length": "691", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} })
33962024-11-05T00:03:42.577ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
33972024-11-05T00:03:42.577ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
33982024-11-05T00:03:42.577ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
33992024-11-05T00:03:42.579ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 408.100177ms iteration = 19 status = {}
34002024-11-05T00:03:42.610ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
34012024-11-05T00:03:42.610ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34022024-11-05T00:03:42.610ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "608ea7c7-01c5-44f9-8751-cdf927550ab5", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} })
34032024-11-05T00:03:42.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34042024-11-05T00:03:42.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34052024-11-05T00:03:42.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34062024-11-05T00:03:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34072024-11-05T00:03:42.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34082024-11-05T00:03:42.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34092024-11-05T00:03:42.620ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34102024-11-05T00:03:42.620ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34112024-11-05T00:03:42.620ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5787f9ad-8ee9-4a37-9cc8-3c80ef4abf0c", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} })
34122024-11-05T00:03:42.622ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 451.027388ms iteration = 19 status = {}
34132024-11-05T00:03:42.640ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34142024-11-05T00:03:42.640ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b172834a-fe37-4326-b93d-9694e814e75a", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34152024-11-05T00:03:42.640ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34162024-11-05T00:03:42.643ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "494b0040-bb6e-42ac-ab7f-114693b906d6", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34172024-11-05T00:03:42.643ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34182024-11-05T00:03:42.644ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 472.842786ms iteration = 19 status = {}
34192024-11-05T00:03:42.645ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ca841c6c-3881-41e9-b2ee-ceb8e036e271", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34202024-11-05T00:03:42.645ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34212024-11-05T00:03:42.647ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34222024-11-05T00:03:42.647ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 476.503721ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34232024-11-05T00:03:42.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34242024-11-05T00:03:42.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34252024-11-05T00:03:42.705ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
34262024-11-05T00:03:42.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34272024-11-05T00:03:42.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34282024-11-05T00:03:42.714ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34292024-11-05T00:03:42.714ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a74dd61e-4a6a-4df5-8214-efcfd39bc5eb", "content-length": "134", "date": "Tue, 05 Nov 2024 00:03:41 GMT"} })
34302024-11-05T00:03:42.714ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34312024-11-05T00:03:42.714ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
34322024-11-05T00:03:42.714ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34332024-11-05T00:03:42.714ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34342024-11-05T00:03:42.714ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34352024-11-05T00:03:42.714ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34362024-11-05T00:03:42.714ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34372024-11-05T00:03:42.714ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34382024-11-05T00:03:42.715ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34392024-11-05T00:03:42.715ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34402024-11-05T00:03:42.715ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
34412024-11-05T00:03:42.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34422024-11-05T00:03:42.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34432024-11-05T00:03:42.717ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34442024-11-05T00:03:42.717ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "58dc90d8-85c3-4d23-9d1f-5430878cf79e", "content-length": "2", "date": "Tue, 05 Nov 2024 00:03:41 GMT"} })
34452024-11-05T00:03:42.717ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34462024-11-05T00:03:42.717ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f155875d-28e1-4799-881b-f2859fda94f8", "content-length": "52", "date": "Tue, 05 Nov 2024 00:03:41 GMT"} })
34472024-11-05T00:03:42.717ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
34482024-11-05T00:03:42.717ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34492024-11-05T00:03:42.899ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0401ec55-4bd9-4022-9729-aa46324d640d", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} })
34502024-11-05T00:03:42.899ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
34512024-11-05T00:03:42.899ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
34522024-11-05T00:03:42.899ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "72146532-91af-4121-8b0d-f34debc4c5b5", "content-length": "682", "date": "Tue, 05 Nov 2024 00:03:42 GMT"} })
34532024-11-05T00:03:42.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34542024-11-05T00:03:42.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34552024-11-05T00:03:42.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34562024-11-05T00:03:42.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34572024-11-05T00:03:42.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34582024-11-05T00:03:42.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34592024-11-05T00:03:42.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34602024-11-05T00:03:42.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34612024-11-05T00:03:42.916ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 745.048244ms iteration = 19 status = {}
34622024-11-05T00:03:42.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 658a1d99-8145-4d43-9f9f-4a478c91aaa4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34632024-11-05T00:03:42.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 658a1d99-8145-4d43-9f9f-4a478c91aaa4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34642024-11-05T00:03:42.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1806 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 658a1d99-8145-4d43-9f9f-4a478c91aaa4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34652024-11-05T00:03:43.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6397098c-2276-4036-a093-a5a75aa7ab32 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34662024-11-05T00:03:43.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6397098c-2276-4036-a093-a5a75aa7ab32 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34672024-11-05T00:03:43.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6397098c-2276-4036-a093-a5a75aa7ab32 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34682024-11-05T00:03:44.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1681d2a4-e292-44d0-8bd4-49d6f030f244 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34692024-11-05T00:03:44.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1681d2a4-e292-44d0-8bd4-49d6f030f244 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34702024-11-05T00:03:44.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1681d2a4-e292-44d0-8bd4-49d6f030f244 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34712024-11-05T00:03:46.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 71d71cf1-d89a-4755-8135-d5daad517363 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34722024-11-05T00:03:46.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 71d71cf1-d89a-4755-8135-d5daad517363 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34732024-11-05T00:03:46.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 71d71cf1-d89a-4755-8135-d5daad517363 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34742024-11-05T00:03:47.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8f13f012-1265-413e-b9a7-62e5d11904ab roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34752024-11-05T00:03:47.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8f13f012-1265-413e-b9a7-62e5d11904ab resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34762024-11-05T00:03:47.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8f13f012-1265-413e-b9a7-62e5d11904ab response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34772024-11-05T00:03:48.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1d2405cb-f7e4-4d5c-aee4-583b446eb628 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34782024-11-05T00:03:48.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1d2405cb-f7e4-4d5c-aee4-583b446eb628 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34792024-11-05T00:03:48.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1d2405cb-f7e4-4d5c-aee4-583b446eb628 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34802024-11-05T00:03:49.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e7c03265-fe01-4bcf-85af-9c7ffd5fff44 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34812024-11-05T00:03:49.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e7c03265-fe01-4bcf-85af-9c7ffd5fff44 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34822024-11-05T00:03:49.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e7c03265-fe01-4bcf-85af-9c7ffd5fff44 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34832024-11-05T00:03:50.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 010eda50-a705-498c-b407-6b4fda659ee9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34842024-11-05T00:03:50.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 010eda50-a705-498c-b407-6b4fda659ee9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34852024-11-05T00:03:50.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 010eda50-a705-498c-b407-6b4fda659ee9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34862024-11-05T00:03:51.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cf7d0e1e-374b-41e3-8b64-51f1400ee539 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34872024-11-05T00:03:51.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cf7d0e1e-374b-41e3-8b64-51f1400ee539 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34882024-11-05T00:03:51.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cf7d0e1e-374b-41e3-8b64-51f1400ee539 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34892024-11-05T00:03:51.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 426 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = ae9688d5-eaa3-47d3-848c-4c12536d1c82 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
34902024-11-05T00:03:52.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 86c984a2-a93a-4862-92bc-f8d2d6e09c35 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34912024-11-05T00:03:52.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 86c984a2-a93a-4862-92bc-f8d2d6e09c35 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34922024-11-05T00:03:52.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 86c984a2-a93a-4862-92bc-f8d2d6e09c35 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
34932024-11-05T00:03:52.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
34942024-11-05T00:03:52.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
34952024-11-05T00:03:52.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34962024-11-05T00:03:52.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34972024-11-05T00:03:52.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34982024-11-05T00:03:52.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34992024-11-05T00:03:52.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35002024-11-05T00:03:52.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35012024-11-05T00:03:52.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35022024-11-05T00:03:52.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.609574ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35032024-11-05T00:03:52.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35042024-11-05T00:03:52.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35052024-11-05T00:03:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35062024-11-05T00:03:52.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35072024-11-05T00:03:52.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35082024-11-05T00:03:52.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35092024-11-05T00:03:52.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
35102024-11-05T00:03:52.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35112024-11-05T00:03:52.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35122024-11-05T00:03:52.202ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
35132024-11-05T00:03:52.202ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.813292ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
35142024-11-05T00:03:53.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a24792fe-178f-45ff-b7d1-f2086f6f3e29 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35152024-11-05T00:03:53.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a24792fe-178f-45ff-b7d1-f2086f6f3e29 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35162024-11-05T00:03:53.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a24792fe-178f-45ff-b7d1-f2086f6f3e29 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35172024-11-05T00:03:54.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 53178a45-3dc5-44fb-883c-29d618130470 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35182024-11-05T00:03:54.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 53178a45-3dc5-44fb-883c-29d618130470 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35192024-11-05T00:03:54.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 53178a45-3dc5-44fb-883c-29d618130470 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35202024-11-05T00:03:55.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0a202117-55cb-4477-a7a2-c35f26ba1b95 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35212024-11-05T00:03:55.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0a202117-55cb-4477-a7a2-c35f26ba1b95 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35222024-11-05T00:03:55.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0a202117-55cb-4477-a7a2-c35f26ba1b95 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35232024-11-05T00:03:56.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9a1727db-799e-4e34-bb8c-67275f2b84bf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35242024-11-05T00:03:56.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9a1727db-799e-4e34-bb8c-67275f2b84bf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35252024-11-05T00:03:56.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9a1727db-799e-4e34-bb8c-67275f2b84bf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35262024-11-05T00:03:57.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 43ef0896-221e-4b6a-b7d1-26959ca53f71 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35272024-11-05T00:03:57.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 43ef0896-221e-4b6a-b7d1-26959ca53f71 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35282024-11-05T00:03:57.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 43ef0896-221e-4b6a-b7d1-26959ca53f71 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35292024-11-05T00:03:58.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 53867e19-4d4d-48d5-8b26-2ea0737fb10c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35302024-11-05T00:03:58.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 53867e19-4d4d-48d5-8b26-2ea0737fb10c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35312024-11-05T00:03:58.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 53867e19-4d4d-48d5-8b26-2ea0737fb10c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35322024-11-05T00:03:59.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2ed71963-a66c-4ca0-8353-28b68d5b6d61 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35332024-11-05T00:03:59.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2ed71963-a66c-4ca0-8353-28b68d5b6d61 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35342024-11-05T00:03:59.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2ed71963-a66c-4ca0-8353-28b68d5b6d61 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35352024-11-05T00:04:00.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d188418e-b5b9-4376-a1a2-d6c7a39f68a5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35362024-11-05T00:04:00.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d188418e-b5b9-4376-a1a2-d6c7a39f68a5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35372024-11-05T00:04:00.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d188418e-b5b9-4376-a1a2-d6c7a39f68a5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35382024-11-05T00:04:01.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4ea73323-ec1a-44a0-b592-9b1931619298 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35392024-11-05T00:04:01.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4ea73323-ec1a-44a0-b592-9b1931619298 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35402024-11-05T00:04:01.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4ea73323-ec1a-44a0-b592-9b1931619298 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35412024-11-05T00:04:02.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
35422024-11-05T00:04:02.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35432024-11-05T00:04:02.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
35442024-11-05T00:04:02.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35452024-11-05T00:04:02.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35462024-11-05T00:04:02.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35472024-11-05T00:04:02.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482024-11-05T00:04:02.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35492024-11-05T00:04:02.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35502024-11-05T00:04:02.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35512024-11-05T00:04:02.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35522024-11-05T00:04:02.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.980432ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35532024-11-05T00:04:02.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35542024-11-05T00:04:02.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35552024-11-05T00:04:02.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35562024-11-05T00:04:02.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35572024-11-05T00:04:02.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
35582024-11-05T00:04:02.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35592024-11-05T00:04:02.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35602024-11-05T00:04:02.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
35612024-11-05T00:04:02.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.058372ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
35622024-11-05T00:04:02.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7a2bade1-8f1e-4fff-b6e6-59c6fd52622d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35632024-11-05T00:04:02.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7a2bade1-8f1e-4fff-b6e6-59c6fd52622d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35642024-11-05T00:04:02.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7a2bade1-8f1e-4fff-b6e6-59c6fd52622d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35652024-11-05T00:04:03.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d0a6b949-330e-4db0-8478-89292c2d5621 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35662024-11-05T00:04:03.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d0a6b949-330e-4db0-8478-89292c2d5621 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35672024-11-05T00:04:03.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d0a6b949-330e-4db0-8478-89292c2d5621 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35682024-11-05T00:04:04.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 33f2c113-c5ba-459a-9b0a-893eb9ef9d23 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35692024-11-05T00:04:04.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 33f2c113-c5ba-459a-9b0a-893eb9ef9d23 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35702024-11-05T00:04:04.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 33f2c113-c5ba-459a-9b0a-893eb9ef9d23 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35712024-11-05T00:04:05.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0606b526-cf67-47e8-bba9-b043686ccf0b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35722024-11-05T00:04:05.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0606b526-cf67-47e8-bba9-b043686ccf0b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35732024-11-05T00:04:05.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0606b526-cf67-47e8-bba9-b043686ccf0b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35742024-11-05T00:04:06.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = da169127-63b5-43c4-9893-b561cf3cfa98 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35752024-11-05T00:04:06.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = da169127-63b5-43c4-9893-b561cf3cfa98 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35762024-11-05T00:04:06.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = da169127-63b5-43c4-9893-b561cf3cfa98 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35772024-11-05T00:04:06.878ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 519 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 8535f99e-272b-463d-bf7e-bfc4badb8dba response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
35782024-11-05T00:04:07.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d1e06221-c1a6-4916-9ee9-627f3ff297c8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35792024-11-05T00:04:07.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d1e06221-c1a6-4916-9ee9-627f3ff297c8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35802024-11-05T00:04:07.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d1e06221-c1a6-4916-9ee9-627f3ff297c8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35812024-11-05T00:04:08.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1f175b81-b179-4d9e-a8c7-2f58fe34deb7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35822024-11-05T00:04:08.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1f175b81-b179-4d9e-a8c7-2f58fe34deb7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35832024-11-05T00:04:08.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1f175b81-b179-4d9e-a8c7-2f58fe34deb7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35842024-11-05T00:04:09.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5a2dce87-bbb7-41ef-9e13-3e5ac0f2bb43 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35852024-11-05T00:04:09.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5a2dce87-bbb7-41ef-9e13-3e5ac0f2bb43 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35862024-11-05T00:04:09.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5a2dce87-bbb7-41ef-9e13-3e5ac0f2bb43 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35872024-11-05T00:04:10.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 69a372ee-195b-4187-a190-cdccc5c84b02 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35882024-11-05T00:04:10.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 69a372ee-195b-4187-a190-cdccc5c84b02 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35892024-11-05T00:04:10.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 69a372ee-195b-4187-a190-cdccc5c84b02 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35902024-11-05T00:04:11.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fc53aa2-5cde-4e22-aea0-6fc47d6b85cf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35912024-11-05T00:04:11.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fc53aa2-5cde-4e22-aea0-6fc47d6b85cf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35922024-11-05T00:04:11.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fc53aa2-5cde-4e22-aea0-6fc47d6b85cf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
35932024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
35942024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
35952024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35962024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35972024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
35982024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35992024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36002024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
36012024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36022024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
36032024-11-05T00:04:12.171ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36042024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
36052024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36062024-11-05T00:04:12.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36072024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
36082024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36092024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
36102024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36112024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
36122024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
36132024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
36142024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
36152024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36162024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36172024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36182024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
36192024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36202024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36212024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
36222024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
36232024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36242024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36252024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36262024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
36272024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.55\u{b5}s iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36282024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.521\u{b5}s iteration = 20 status = {"errors":[],"records_set_to_done":[]}
36292024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
36302024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.91\u{b5}s iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
36312024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36322024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36332024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.16\u{b5}s iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36342024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36352024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36362024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36372024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36382024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36392024-11-05T00:04:12.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36402024-11-05T00:04:12.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36412024-11-05T00:04:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.753086ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36422024-11-05T00:04:12.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36432024-11-05T00:04:12.176ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36442024-11-05T00:04:12.176ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36452024-11-05T00:04:12.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36462024-11-05T00:04:12.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2895, tv_nsec: 762907466 } })
36472024-11-05T00:04:12.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36482024-11-05T00:04:12.176ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
36492024-11-05T00:04:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36502024-11-05T00:04:12.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36512024-11-05T00:04:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36522024-11-05T00:04:12.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36532024-11-05T00:04:12.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36542024-11-05T00:04:12.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36552024-11-05T00:04:12.179ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36562024-11-05T00:04:12.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36572024-11-05T00:04:12.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36582024-11-05T00:04:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36592024-11-05T00:04:12.181ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36602024-11-05T00:04:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36612024-11-05T00:04:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36622024-11-05T00:04:12.182ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36632024-11-05T00:04:12.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36642024-11-05T00:04:12.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36652024-11-05T00:04:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36662024-11-05T00:04:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36672024-11-05T00:04:12.183ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2895, tv_nsec: 769946030 } })
36682024-11-05T00:04:12.183ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
36692024-11-05T00:04:12.184ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36702024-11-05T00:04:12.184ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36712024-11-05T00:04:12.184ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36722024-11-05T00:04:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36732024-11-05T00:04:12.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36742024-11-05T00:04:12.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36752024-11-05T00:04:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36762024-11-05T00:04:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36772024-11-05T00:04:12.186ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2895, tv_nsec: 773123836 } })
36782024-11-05T00:04:12.186ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
36792024-11-05T00:04:12.186ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36802024-11-05T00:04:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36812024-11-05T00:04:12.187ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36822024-11-05T00:04:12.187ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36832024-11-05T00:04:12.187ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 15.961907ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36842024-11-05T00:04:12.188ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36852024-11-05T00:04:12.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36862024-11-05T00:04:12.190ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36872024-11-05T00:04:12.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36882024-11-05T00:04:12.191ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36892024-11-05T00:04:12.191ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.415298ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36902024-11-05T00:04:12.225ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36912024-11-05T00:04:12.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36922024-11-05T00:04:12.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36932024-11-05T00:04:12.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36942024-11-05T00:04:12.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.019092ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36952024-11-05T00:04:12.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36962024-11-05T00:04:12.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36972024-11-05T00:04:12.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36982024-11-05T00:04:12.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36992024-11-05T00:04:12.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37002024-11-05T00:04:12.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37012024-11-05T00:04:12.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37022024-11-05T00:04:12.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37032024-11-05T00:04:12.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37042024-11-05T00:04:12.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37052024-11-05T00:04:12.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37062024-11-05T00:04:12.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
37072024-11-05T00:04:12.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37082024-11-05T00:04:12.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37092024-11-05T00:04:12.254ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 82.077124ms iteration = 22 status = {"physical_disks_added":0}
37102024-11-05T00:04:12.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37112024-11-05T00:04:12.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37122024-11-05T00:04:12.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37132024-11-05T00:04:12.256ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
37142024-11-05T00:04:12.256ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37152024-11-05T00:04:12.257ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eefecf7d-24d6-4ac7-ac04-e39280186f11", "content-length": "26", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
37162024-11-05T00:04:12.257ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37172024-11-05T00:04:12.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37182024-11-05T00:04:12.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37192024-11-05T00:04:12.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37202024-11-05T00:04:12.259ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37212024-11-05T00:04:12.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37222024-11-05T00:04:12.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.16797ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37232024-11-05T00:04:12.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37242024-11-05T00:04:12.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37252024-11-05T00:04:12.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37262024-11-05T00:04:12.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37272024-11-05T00:04:12.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37282024-11-05T00:04:12.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
37292024-11-05T00:04:12.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.577679ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
37302024-11-05T00:04:12.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37312024-11-05T00:04:12.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37322024-11-05T00:04:12.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
37332024-11-05T00:04:12.276ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37342024-11-05T00:04:12.276ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f358815-5c03-41fd-a4a8-92881e397da4", "content-length": "26", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
37352024-11-05T00:04:12.276ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37362024-11-05T00:04:12.278ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
37372024-11-05T00:04:12.278ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
37382024-11-05T00:04:12.278ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37392024-11-05T00:04:12.279ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "766ebc96-70f4-41fe-9d84-173ad1de8d7d", "content-length": "26", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
37402024-11-05T00:04:12.279ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37412024-11-05T00:04:12.280ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37422024-11-05T00:04:12.381ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 210.087022ms iteration = 20 status = {}
37432024-11-05T00:04:12.389ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37442024-11-05T00:04:12.389ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d04951ab-4027-4638-8a38-9744fba25f73", "content-length": "691", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
37452024-11-05T00:04:12.389ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37462024-11-05T00:04:12.390ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37472024-11-05T00:04:12.390ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37482024-11-05T00:04:12.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37492024-11-05T00:04:12.391ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 219.977795ms iteration = 20 status = {}
37502024-11-05T00:04:12.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
37512024-11-05T00:04:12.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37522024-11-05T00:04:12.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37532024-11-05T00:04:12.396ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 224.446916ms iteration = 20 status = 0
37542024-11-05T00:04:12.400ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37552024-11-05T00:04:12.400ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b96c2aba-c15e-4539-92d6-690326cc05ba", "content-length": "1", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
37562024-11-05T00:04:12.401ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37572024-11-05T00:04:12.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37582024-11-05T00:04:12.403ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 231.40129ms iteration = 20 status = null
37592024-11-05T00:04:12.417ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37602024-11-05T00:04:12.417ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37612024-11-05T00:04:12.417ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a70ee28-a4cd-4e58-aa70-80514add9624", "content-length": "372", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
37622024-11-05T00:04:12.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37632024-11-05T00:04:12.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37642024-11-05T00:04:12.432ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37652024-11-05T00:04:12.432ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37662024-11-05T00:04:12.432ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9e635b40-b0b4-442e-ab8b-62219a542593", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
37672024-11-05T00:04:12.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37682024-11-05T00:04:12.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37692024-11-05T00:04:12.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37702024-11-05T00:04:12.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37712024-11-05T00:04:12.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37722024-11-05T00:04:12.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37732024-11-05T00:04:12.441ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37742024-11-05T00:04:12.441ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37752024-11-05T00:04:12.442ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "464189e6-0854-4cf6-bfdc-c6ecb4b2296e", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
37762024-11-05T00:04:12.443ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 271.719627ms iteration = 20 status = {}
37772024-11-05T00:04:12.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37782024-11-05T00:04:12.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37792024-11-05T00:04:12.475ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
37802024-11-05T00:04:12.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37812024-11-05T00:04:12.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37822024-11-05T00:04:12.491ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37832024-11-05T00:04:12.491ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "566de8b6-1be0-4f5e-9101-afbe99018794", "content-length": "134", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
37842024-11-05T00:04:12.491ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37852024-11-05T00:04:12.491ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
37862024-11-05T00:04:12.492ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37872024-11-05T00:04:12.492ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37882024-11-05T00:04:12.492ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37892024-11-05T00:04:12.492ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37902024-11-05T00:04:12.492ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37912024-11-05T00:04:12.492ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37922024-11-05T00:04:12.492ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37932024-11-05T00:04:12.492ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37942024-11-05T00:04:12.492ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
37952024-11-05T00:04:12.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37962024-11-05T00:04:12.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37972024-11-05T00:04:12.494ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37982024-11-05T00:04:12.494ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "be3473cf-439f-48a7-91e7-787b1afa95a5", "content-length": "2", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
37992024-11-05T00:04:12.494ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38002024-11-05T00:04:12.494ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "68671788-8fc8-4418-9feb-a2ca279b4efe", "content-length": "52", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
38012024-11-05T00:04:12.494ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
38022024-11-05T00:04:12.494ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38032024-11-05T00:04:12.604ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "48fe61ae-db92-41e3-8384-03bdb77b9042", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
38042024-11-05T00:04:12.604ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
38052024-11-05T00:04:12.604ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38062024-11-05T00:04:12.605ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "67453ce6-a351-4a7f-a122-f063bf7622e9", "content-length": "682", "date": "Tue, 05 Nov 2024 00:04:12 GMT"} })
38072024-11-05T00:04:12.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38082024-11-05T00:04:12.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38092024-11-05T00:04:12.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38102024-11-05T00:04:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38112024-11-05T00:04:12.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38122024-11-05T00:04:12.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38132024-11-05T00:04:12.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38142024-11-05T00:04:12.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38152024-11-05T00:04:12.623ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 451.172322ms iteration = 20 status = {}
38162024-11-05T00:04:12.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2c3f3ed6-7208-45f7-9583-b31e87869598 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38172024-11-05T00:04:12.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2c3f3ed6-7208-45f7-9583-b31e87869598 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38182024-11-05T00:04:12.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2c3f3ed6-7208-45f7-9583-b31e87869598 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38192024-11-05T00:04:13.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a57a4e18-427a-4061-a196-433eba91a8ad roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38202024-11-05T00:04:13.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a57a4e18-427a-4061-a196-433eba91a8ad resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38212024-11-05T00:04:13.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a57a4e18-427a-4061-a196-433eba91a8ad response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38222024-11-05T00:04:14.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f77e9e0c-663b-476b-899d-20442cc1f375 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38232024-11-05T00:04:14.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f77e9e0c-663b-476b-899d-20442cc1f375 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38242024-11-05T00:04:14.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f77e9e0c-663b-476b-899d-20442cc1f375 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38252024-11-05T00:04:15.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5c4a8c0d-5ead-4233-9bb0-ca3a07b56f36 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38262024-11-05T00:04:15.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5c4a8c0d-5ead-4233-9bb0-ca3a07b56f36 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38272024-11-05T00:04:15.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5c4a8c0d-5ead-4233-9bb0-ca3a07b56f36 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38282024-11-05T00:04:16.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 49abd6ad-9613-4c83-a015-ece5327e05f9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38292024-11-05T00:04:16.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 49abd6ad-9613-4c83-a015-ece5327e05f9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38302024-11-05T00:04:16.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 49abd6ad-9613-4c83-a015-ece5327e05f9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38312024-11-05T00:04:17.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 47797c45-37ef-43cf-96f8-92281ef37459 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38322024-11-05T00:04:17.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 47797c45-37ef-43cf-96f8-92281ef37459 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38332024-11-05T00:04:17.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 47797c45-37ef-43cf-96f8-92281ef37459 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38342024-11-05T00:04:18.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6b85d8dd-1960-4e30-aee9-b23408c845df roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38352024-11-05T00:04:18.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6b85d8dd-1960-4e30-aee9-b23408c845df resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38362024-11-05T00:04:18.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6b85d8dd-1960-4e30-aee9-b23408c845df response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38372024-11-05T00:04:19.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d85acfbb-859c-482b-a2a1-a26cdaafcbff roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38382024-11-05T00:04:19.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d85acfbb-859c-482b-a2a1-a26cdaafcbff resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38392024-11-05T00:04:19.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d85acfbb-859c-482b-a2a1-a26cdaafcbff response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38402024-11-05T00:04:20.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e598661a-cf4f-4a2f-ab4f-9305051e70af roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38412024-11-05T00:04:20.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e598661a-cf4f-4a2f-ab4f-9305051e70af resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38422024-11-05T00:04:20.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e598661a-cf4f-4a2f-ab4f-9305051e70af response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38432024-11-05T00:04:21.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 592 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = ccfeb53f-9277-4bc8-a40e-365c908f91a8 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
38442024-11-05T00:04:21.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 31ccd49d-d5dd-41cd-b4bb-d73570cf3d6c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38452024-11-05T00:04:21.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 31ccd49d-d5dd-41cd-b4bb-d73570cf3d6c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38462024-11-05T00:04:21.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 31ccd49d-d5dd-41cd-b4bb-d73570cf3d6c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38472024-11-05T00:04:22.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
38482024-11-05T00:04:22.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38492024-11-05T00:04:22.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
38502024-11-05T00:04:22.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38512024-11-05T00:04:22.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38522024-11-05T00:04:22.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38532024-11-05T00:04:22.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38542024-11-05T00:04:22.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38552024-11-05T00:04:22.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38562024-11-05T00:04:22.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.262887ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38572024-11-05T00:04:22.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38582024-11-05T00:04:22.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38592024-11-05T00:04:22.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38602024-11-05T00:04:22.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38612024-11-05T00:04:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38622024-11-05T00:04:22.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38632024-11-05T00:04:22.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
38642024-11-05T00:04:22.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38652024-11-05T00:04:22.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38662024-11-05T00:04:22.190ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
38672024-11-05T00:04:22.190ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.746965ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
38682024-11-05T00:04:22.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 71120bbe-69fe-4771-b623-238859ddd3d9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38692024-11-05T00:04:22.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 71120bbe-69fe-4771-b623-238859ddd3d9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38702024-11-05T00:04:22.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 71120bbe-69fe-4771-b623-238859ddd3d9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38712024-11-05T00:04:23.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7c09470e-64cc-46ff-8df5-98b329f57178 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38722024-11-05T00:04:23.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7c09470e-64cc-46ff-8df5-98b329f57178 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38732024-11-05T00:04:23.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7c09470e-64cc-46ff-8df5-98b329f57178 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38742024-11-05T00:04:25.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d005d17a-01ff-44c2-9f29-d5e2f36c8dd9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38752024-11-05T00:04:25.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d005d17a-01ff-44c2-9f29-d5e2f36c8dd9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38762024-11-05T00:04:25.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d005d17a-01ff-44c2-9f29-d5e2f36c8dd9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38772024-11-05T00:04:26.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ef090dc8-6b95-41a4-9a42-0dd65c1ca44f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38782024-11-05T00:04:26.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ef090dc8-6b95-41a4-9a42-0dd65c1ca44f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38792024-11-05T00:04:26.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ef090dc8-6b95-41a4-9a42-0dd65c1ca44f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38802024-11-05T00:04:26.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = ab69cc8c-f41b-475d-aeb1-3346cfb1dde0 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
38812024-11-05T00:04:26.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = ab69cc8c-f41b-475d-aeb1-3346cfb1dde0 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
38822024-11-05T00:04:26.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = ab69cc8c-f41b-475d-aeb1-3346cfb1dde0 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
38832024-11-05T00:04:26.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 05f23251-5673-41ae-97ce-22819f80e891 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
38842024-11-05T00:04:26.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 05f23251-5673-41ae-97ce-22819f80e891 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
38852024-11-05T00:04:26.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46102 req_id = 05f23251-5673-41ae-97ce-22819f80e891 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
38862024-11-05T00:04:27.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 118a908a-3b4a-4d8b-97b6-4fab8c7687f1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38872024-11-05T00:04:27.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 118a908a-3b4a-4d8b-97b6-4fab8c7687f1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38882024-11-05T00:04:27.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 118a908a-3b4a-4d8b-97b6-4fab8c7687f1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38892024-11-05T00:04:28.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c1d33587-b2c2-4f2b-bb55-e99f48e747b3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38902024-11-05T00:04:28.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c1d33587-b2c2-4f2b-bb55-e99f48e747b3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38912024-11-05T00:04:28.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c1d33587-b2c2-4f2b-bb55-e99f48e747b3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38922024-11-05T00:04:29.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 56633dd9-6aff-4e8d-a49c-e8d5223edd82 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38932024-11-05T00:04:29.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 56633dd9-6aff-4e8d-a49c-e8d5223edd82 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38942024-11-05T00:04:29.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 56633dd9-6aff-4e8d-a49c-e8d5223edd82 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38952024-11-05T00:04:30.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bede9f9f-8fe5-4752-80a9-d24cf350b8d0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38962024-11-05T00:04:30.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bede9f9f-8fe5-4752-80a9-d24cf350b8d0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38972024-11-05T00:04:30.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bede9f9f-8fe5-4752-80a9-d24cf350b8d0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38982024-11-05T00:04:31.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b414e216-fa87-4626-a77b-b240b0e12b62 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
38992024-11-05T00:04:31.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b414e216-fa87-4626-a77b-b240b0e12b62 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39002024-11-05T00:04:31.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b414e216-fa87-4626-a77b-b240b0e12b62 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39012024-11-05T00:04:32.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
39022024-11-05T00:04:32.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39032024-11-05T00:04:32.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
39042024-11-05T00:04:32.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39052024-11-05T00:04:32.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39062024-11-05T00:04:32.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39072024-11-05T00:04:32.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39082024-11-05T00:04:32.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39092024-11-05T00:04:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39102024-11-05T00:04:32.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.997223ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39112024-11-05T00:04:32.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39122024-11-05T00:04:32.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39132024-11-05T00:04:32.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39142024-11-05T00:04:32.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 947acfc4-2faa-4f55-880f-98b687610ab0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39152024-11-05T00:04:32.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 947acfc4-2faa-4f55-880f-98b687610ab0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39162024-11-05T00:04:32.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39172024-11-05T00:04:32.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39182024-11-05T00:04:32.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1717 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 947acfc4-2faa-4f55-880f-98b687610ab0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39192024-11-05T00:04:32.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39202024-11-05T00:04:32.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
39212024-11-05T00:04:32.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39222024-11-05T00:04:32.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39232024-11-05T00:04:32.193ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
39242024-11-05T00:04:32.193ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.581873ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
39252024-11-05T00:04:33.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 18481bcc-b590-42ba-9f59-127432f6b4d1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39262024-11-05T00:04:33.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 18481bcc-b590-42ba-9f59-127432f6b4d1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39272024-11-05T00:04:33.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 18481bcc-b590-42ba-9f59-127432f6b4d1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39282024-11-05T00:04:34.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d093f66d-8861-41e0-8d1f-f2bbd26330d1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39292024-11-05T00:04:34.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d093f66d-8861-41e0-8d1f-f2bbd26330d1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39302024-11-05T00:04:34.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d093f66d-8861-41e0-8d1f-f2bbd26330d1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39312024-11-05T00:04:35.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6b061b97-13e0-430a-8c90-547d6c773131 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39322024-11-05T00:04:35.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6b061b97-13e0-430a-8c90-547d6c773131 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39332024-11-05T00:04:35.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6b061b97-13e0-430a-8c90-547d6c773131 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39342024-11-05T00:04:36.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a01b3f1f-a95c-46e7-b422-8bbdf16a4318 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39352024-11-05T00:04:36.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a01b3f1f-a95c-46e7-b422-8bbdf16a4318 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39362024-11-05T00:04:36.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a01b3f1f-a95c-46e7-b422-8bbdf16a4318 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39372024-11-05T00:04:36.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 510 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 5ae13365-1566-4123-9f23-0dbc8ebccee0 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
39382024-11-05T00:04:37.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d3ebe26f-d53a-4c19-a749-af36cd22636b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39392024-11-05T00:04:37.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d3ebe26f-d53a-4c19-a749-af36cd22636b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39402024-11-05T00:04:37.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d3ebe26f-d53a-4c19-a749-af36cd22636b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39412024-11-05T00:04:38.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6a0ae77-1769-4733-813d-6c8e1144f67e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39422024-11-05T00:04:38.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6a0ae77-1769-4733-813d-6c8e1144f67e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39432024-11-05T00:04:38.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6a0ae77-1769-4733-813d-6c8e1144f67e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39442024-11-05T00:04:39.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f9c7bd16-b3c1-4ff2-b584-ee3a13bdfaad roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39452024-11-05T00:04:39.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f9c7bd16-b3c1-4ff2-b584-ee3a13bdfaad resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39462024-11-05T00:04:39.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f9c7bd16-b3c1-4ff2-b584-ee3a13bdfaad response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39472024-11-05T00:04:40.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e9944e04-1129-418a-8b24-6cbeb0fc593b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39482024-11-05T00:04:40.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e9944e04-1129-418a-8b24-6cbeb0fc593b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39492024-11-05T00:04:40.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e9944e04-1129-418a-8b24-6cbeb0fc593b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39502024-11-05T00:04:41.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 92f218e6-2c7b-4ec6-82db-3f8dbf7b5e91 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39512024-11-05T00:04:41.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 92f218e6-2c7b-4ec6-82db-3f8dbf7b5e91 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39522024-11-05T00:04:41.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 92f218e6-2c7b-4ec6-82db-3f8dbf7b5e91 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
39532024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
39542024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39552024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
39562024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39572024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39582024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
39592024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
39602024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39612024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
39622024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
39632024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39642024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39652024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
39662024-11-05T00:04:42.172ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39672024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39682024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39692024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
39702024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
39712024-11-05T00:04:42.172ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-04 23:54:42.172601202 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39722024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39732024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
39742024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39752024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
39762024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39772024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
39782024-11-05T00:04:42.172ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
39792024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39802024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
39812024-11-05T00:04:42.172ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970
39822024-11-05T00:04:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.68\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970"}
39832024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
39842024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
39852024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
39862024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39872024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39882024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
39892024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
39902024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39912024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39922024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
39932024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
39942024-11-05T00:04:42.173ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39952024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39962024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
39972024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
39982024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39992024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
40002024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40012024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40022024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
40032024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40042024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
40052024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40062024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
40072024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.52\u{b5}s iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40082024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
40092024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
40102024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
40112024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.42\u{b5}s iteration = 21 status = {"errors":[],"records_set_to_done":[]}
40122024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40132024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40142024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
40152024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.49\u{b5}s iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
40162024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
40172024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
40182024-11-05T00:04:42.173ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
40192024-11-05T00:04:42.173ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
40202024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 13.31\u{b5}s iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40212024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40222024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40232024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40242024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40252024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40262024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
40272024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40282024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40292024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40302024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40312024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40322024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40332024-11-05T00:04:42.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("08f058bf-bffa-4561-8799-2d5d32641d33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e5a3f00-3f5b-4cac-8aa4-99515a0afee2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2925, tv_nsec: 760237111 } })
40342024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40352024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40362024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40372024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40382024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40392024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40402024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40412024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40422024-11-05T00:04:42.173ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
40432024-11-05T00:04:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40442024-11-05T00:04:42.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f4c9dd5-dad6-4fc2-ba58-b064adbea295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2925, tv_nsec: 760392284 } })
40452024-11-05T00:04:42.174ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
40462024-11-05T00:04:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.726416ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
40472024-11-05T00:04:42.174ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
40482024-11-05T00:04:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.563562ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
40492024-11-05T00:04:42.174ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2925, tv_nsec: 761405115 } })
40502024-11-05T00:04:42.175ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
40512024-11-05T00:04:42.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40522024-11-05T00:04:42.176ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40532024-11-05T00:04:42.176ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.227407ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40542024-11-05T00:04:42.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40552024-11-05T00:04:42.177ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-04 23:54:42.172601202 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40562024-11-05T00:04:42.177ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.189757ms iteration = 11 status = {"expiration":"2024-11-04T23:54:42.172601202Z","pruned":[]}
40572024-11-05T00:04:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40582024-11-05T00:04:42.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40592024-11-05T00:04:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40602024-11-05T00:04:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40612024-11-05T00:04:42.179ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40622024-11-05T00:04:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40632024-11-05T00:04:42.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40642024-11-05T00:04:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40652024-11-05T00:04:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40662024-11-05T00:04:42.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40672024-11-05T00:04:42.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40682024-11-05T00:04:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40692024-11-05T00:04:42.181ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40702024-11-05T00:04:42.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40712024-11-05T00:04:42.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40722024-11-05T00:04:42.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40732024-11-05T00:04:42.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40742024-11-05T00:04:42.183ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40752024-11-05T00:04:42.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40762024-11-05T00:04:42.183ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40772024-11-05T00:04:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40782024-11-05T00:04:42.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40792024-11-05T00:04:42.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40802024-11-05T00:04:42.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40812024-11-05T00:04:42.185ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40822024-11-05T00:04:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40832024-11-05T00:04:42.186ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2925, tv_nsec: 772892561 } })
40842024-11-05T00:04:42.186ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40852024-11-05T00:04:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40862024-11-05T00:04:42.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40872024-11-05T00:04:42.186ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
40882024-11-05T00:04:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40892024-11-05T00:04:42.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40902024-11-05T00:04:42.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40912024-11-05T00:04:42.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40922024-11-05T00:04:42.189ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40932024-11-05T00:04:42.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40942024-11-05T00:04:42.192ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.216194ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
40952024-11-05T00:04:42.192ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40962024-11-05T00:04:42.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40972024-11-05T00:04:42.193ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40982024-11-05T00:04:42.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40992024-11-05T00:04:42.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41002024-11-05T00:04:42.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41012024-11-05T00:04:42.194ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41022024-11-05T00:04:42.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41032024-11-05T00:04:42.195ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41042024-11-05T00:04:42.195ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 22.653385ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41052024-11-05T00:04:42.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41062024-11-05T00:04:42.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41072024-11-05T00:04:42.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41082024-11-05T00:04:42.196ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2925, tv_nsec: 783317765 } })
41092024-11-05T00:04:42.197ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
41102024-11-05T00:04:42.197ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41112024-11-05T00:04:42.198ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41122024-11-05T00:04:42.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41132024-11-05T00:04:42.200ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41142024-11-05T00:04:42.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41152024-11-05T00:04:42.202ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41162024-11-05T00:04:42.202ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 29.329313ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41172024-11-05T00:04:42.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
41182024-11-05T00:04:42.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41192024-11-05T00:04:42.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41202024-11-05T00:04:42.204ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41212024-11-05T00:04:42.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41222024-11-05T00:04:42.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41232024-11-05T00:04:42.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
41242024-11-05T00:04:42.207ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41252024-11-05T00:04:42.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41262024-11-05T00:04:42.209ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41272024-11-05T00:04:42.209ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41282024-11-05T00:04:42.209ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41292024-11-05T00:04:42.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41302024-11-05T00:04:42.212ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41312024-11-05T00:04:42.212ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41322024-11-05T00:04:42.212ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41332024-11-05T00:04:42.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41342024-11-05T00:04:42.225ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
41352024-11-05T00:04:42.225ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.925986ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
41362024-11-05T00:04:42.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41372024-11-05T00:04:42.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41382024-11-05T00:04:42.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41392024-11-05T00:04:42.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41402024-11-05T00:04:42.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41412024-11-05T00:04:42.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41422024-11-05T00:04:42.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41432024-11-05T00:04:42.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41442024-11-05T00:04:42.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41452024-11-05T00:04:42.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41462024-11-05T00:04:42.249ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
41472024-11-05T00:04:42.249ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
41482024-11-05T00:04:42.249ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.157894ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
41492024-11-05T00:04:42.252ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41502024-11-05T00:04:42.252ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41512024-11-05T00:04:42.252ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.968412ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41522024-11-05T00:04:42.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41532024-11-05T00:04:42.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.098726ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41542024-11-05T00:04:42.257ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
41552024-11-05T00:04:42.257ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 84.227228ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
41562024-11-05T00:04:42.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41572024-11-05T00:04:42.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41582024-11-05T00:04:42.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41592024-11-05T00:04:42.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41602024-11-05T00:04:42.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41612024-11-05T00:04:42.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41622024-11-05T00:04:42.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
41632024-11-05T00:04:42.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41642024-11-05T00:04:42.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41652024-11-05T00:04:42.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41662024-11-05T00:04:42.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41672024-11-05T00:04:42.271ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.822319ms iteration = 21 status = 0
41682024-11-05T00:04:42.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41692024-11-05T00:04:42.273ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41702024-11-05T00:04:42.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41712024-11-05T00:04:42.273ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.025103ms iteration = 23 status = {"physical_disks_added":0}
41722024-11-05T00:04:42.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41732024-11-05T00:04:42.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41742024-11-05T00:04:42.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41752024-11-05T00:04:42.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41762024-11-05T00:04:42.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41772024-11-05T00:04:42.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41782024-11-05T00:04:42.281ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41792024-11-05T00:04:42.281ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41802024-11-05T00:04:42.281ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.594839ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41812024-11-05T00:04:42.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
41822024-11-05T00:04:42.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41832024-11-05T00:04:42.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41842024-11-05T00:04:42.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41852024-11-05T00:04:42.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41862024-11-05T00:04:42.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41872024-11-05T00:04:42.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41882024-11-05T00:04:42.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41892024-11-05T00:04:42.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
41902024-11-05T00:04:42.296ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41912024-11-05T00:04:42.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41922024-11-05T00:04:42.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41932024-11-05T00:04:42.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41942024-11-05T00:04:42.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41952024-11-05T00:04:42.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41962024-11-05T00:04:42.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41972024-11-05T00:04:42.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41982024-11-05T00:04:42.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41992024-11-05T00:04:42.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42002024-11-05T00:04:42.308ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42012024-11-05T00:04:42.308ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42022024-11-05T00:04:42.309ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42032024-11-05T00:04:42.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42042024-11-05T00:04:42.309ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42052024-11-05T00:04:42.309ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42062024-11-05T00:04:42.309ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42072024-11-05T00:04:42.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42082024-11-05T00:04:42.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42092024-11-05T00:04:42.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42102024-11-05T00:04:42.310ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42112024-11-05T00:04:42.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42122024-11-05T00:04:42.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42132024-11-05T00:04:42.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42142024-11-05T00:04:42.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42152024-11-05T00:04:42.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42162024-11-05T00:04:42.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42172024-11-05T00:04:42.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42182024-11-05T00:04:42.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42192024-11-05T00:04:42.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42202024-11-05T00:04:42.318ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42212024-11-05T00:04:42.318ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 0 version = 2
42222024-11-05T00:04:42.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42232024-11-05T00:04:42.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42242024-11-05T00:04:42.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42252024-11-05T00:04:42.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42262024-11-05T00:04:42.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42272024-11-05T00:04:42.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42282024-11-05T00:04:42.325ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 1 version = 2
42292024-11-05T00:04:42.325ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42302024-11-05T00:04:42.325ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-04 23:54:45.073528 UTC dns_group = external generation = 2
42312024-11-05T00:04:42.325ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 152.729575ms iteration = 11 status = {"generation":2}
42322024-11-05T00:04:42.325ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-04T23:54:39.943212Z, time_modified: 2024-11-04T23:54:39.943212Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }) }
42332024-11-05T00:04:42.325ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 152.735375ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]}},"default_endpoint":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42342024-11-05T00:04:42.330ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42352024-11-05T00:04:42.344ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42362024-11-05T00:04:42.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42372024-11-05T00:04:42.345ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
42382024-11-05T00:04:42.345ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
42392024-11-05T00:04:42.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42402024-11-05T00:04:42.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42412024-11-05T00:04:42.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42422024-11-05T00:04:42.351ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42432024-11-05T00:04:42.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42442024-11-05T00:04:42.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42452024-11-05T00:04:42.353ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42462024-11-05T00:04:42.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42472024-11-05T00:04:42.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42482024-11-05T00:04:42.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42492024-11-05T00:04:42.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42502024-11-05T00:04:42.356ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42512024-11-05T00:04:42.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42522024-11-05T00:04:42.356ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42532024-11-05T00:04:42.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42542024-11-05T00:04:42.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
42552024-11-05T00:04:42.359ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42562024-11-05T00:04:42.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42572024-11-05T00:04:42.364ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
42582024-11-05T00:04:42.364ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42592024-11-05T00:04:42.364ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "804ebbe9-c09a-4138-9f9f-2847c0e9d73b", "content-length": "26", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
42602024-11-05T00:04:42.364ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42612024-11-05T00:04:42.365ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42622024-11-05T00:04:42.392ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
42632024-11-05T00:04:42.392ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 220.109778ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
42642024-11-05T00:04:42.392ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
42652024-11-05T00:04:42.392ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42662024-11-05T00:04:42.393ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee4ee48a-b000-444e-a201-209d1dd0c29c", "content-length": "26", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
42672024-11-05T00:04:42.393ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42682024-11-05T00:04:42.395ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
42692024-11-05T00:04:42.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d3ebfb67-5aea-4dc9-80d9-9c069d2e791f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
42702024-11-05T00:04:42.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d3ebfb67-5aea-4dc9-80d9-9c069d2e791f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
42712024-11-05T00:04:42.453ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
42722024-11-05T00:04:42.453ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42732024-11-05T00:04:42.453ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c05ccf30-a56a-41a6-848e-22c5edf476af", "content-length": "26", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
42742024-11-05T00:04:42.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42752024-11-05T00:04:42.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42762024-11-05T00:04:42.488ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
42772024-11-05T00:04:42.493ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42782024-11-05T00:04:42.494ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "772c83c0-bc02-404e-8588-ba36f65b6938", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42792024-11-05T00:04:42.494ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42802024-11-05T00:04:42.496ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42812024-11-05T00:04:42.496ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42822024-11-05T00:04:42.496ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "014462d1-81fb-457b-9000-7330c2802a8c", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42832024-11-05T00:04:42.496ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42842024-11-05T00:04:42.498ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42852024-11-05T00:04:42.498ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 325.87193ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
42862024-11-05T00:04:42.500ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "10d0d865-0618-456d-8ba4-849cde27de24", "content-length": "372", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
42872024-11-05T00:04:42.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42882024-11-05T00:04:42.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42892024-11-05T00:04:42.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42902024-11-05T00:04:42.501ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
42912024-11-05T00:04:42.501ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
42922024-11-05T00:04:42.501ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-04 23:54:43.769339 UTC dns_group = internal generation = 1
42932024-11-05T00:04:42.501ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 328.878401ms iteration = 11 status = {"generation":1}
42942024-11-05T00:04:42.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42952024-11-05T00:04:42.502ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42962024-11-05T00:04:42.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42972024-11-05T00:04:42.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d3ebfb67-5aea-4dc9-80d9-9c069d2e791f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
42982024-11-05T00:04:42.506ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42992024-11-05T00:04:42.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43002024-11-05T00:04:42.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43012024-11-05T00:04:42.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43022024-11-05T00:04:42.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43032024-11-05T00:04:42.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43042024-11-05T00:04:42.516ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43052024-11-05T00:04:42.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43062024-11-05T00:04:42.518ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43072024-11-05T00:04:42.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43082024-11-05T00:04:42.520ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
43092024-11-05T00:04:42.520ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43102024-11-05T00:04:42.520ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bd8b61e0-aee9-4da4-807c-e7c24d0f7fbd", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
43112024-11-05T00:04:42.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43122024-11-05T00:04:42.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43132024-11-05T00:04:42.562ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 389.434474ms iteration = 21 status = {}
43142024-11-05T00:04:42.564ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43152024-11-05T00:04:42.564ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c150ea99-5d72-4d32-a2ed-656def454df0", "content-length": "1", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
43162024-11-05T00:04:42.567ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43172024-11-05T00:04:42.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43182024-11-05T00:04:42.616ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43192024-11-05T00:04:42.709ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43202024-11-05T00:04:42.709ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6636b7dc-dc8e-4fd0-bd8e-a26008a876ad", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
43212024-11-05T00:04:42.709ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
43222024-11-05T00:04:42.710ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "44abbb7e-eaae-4ebf-ba9d-4797618ba594", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
43232024-11-05T00:04:42.710ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
43242024-11-05T00:04:42.712ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9cb29276-26c9-4b78-9eda-ed09a4e12a16", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
43252024-11-05T00:04:42.712ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
43262024-11-05T00:04:42.714ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
43272024-11-05T00:04:42.714ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 541.788371ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43282024-11-05T00:04:42.730ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43292024-11-05T00:04:42.730ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c58511b-0c81-43f9-aca6-038c4c68aacf", "content-length": "691", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
43302024-11-05T00:04:42.730ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43312024-11-05T00:04:42.730ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43322024-11-05T00:04:42.730ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43332024-11-05T00:04:42.731ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43342024-11-05T00:04:42.732ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 559.314231ms iteration = 21 status = {}
43352024-11-05T00:04:42.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43362024-11-05T00:04:42.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43372024-11-05T00:04:42.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43382024-11-05T00:04:42.732ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 560.511767ms iteration = 21 status = null
43392024-11-05T00:04:42.733ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43402024-11-05T00:04:42.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43412024-11-05T00:04:42.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43422024-11-05T00:04:42.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
43432024-11-05T00:04:42.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43442024-11-05T00:04:42.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43452024-11-05T00:04:42.738ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43462024-11-05T00:04:42.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43472024-11-05T00:04:42.739ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43482024-11-05T00:04:42.739ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43492024-11-05T00:04:42.739ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0e7ddfd3-8a16-4d36-bd59-2775aecf410c", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
43502024-11-05T00:04:42.740ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43512024-11-05T00:04:42.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43522024-11-05T00:04:42.741ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 568.868808ms iteration = 21 status = {}
43532024-11-05T00:04:42.742ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43542024-11-05T00:04:42.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
43552024-11-05T00:04:42.746ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43562024-11-05T00:04:42.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43572024-11-05T00:04:42.751ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43582024-11-05T00:04:42.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43592024-11-05T00:04:42.753ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43602024-11-05T00:04:42.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43612024-11-05T00:04:42.755ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43622024-11-05T00:04:42.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43632024-11-05T00:04:42.757ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43642024-11-05T00:04:42.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43652024-11-05T00:04:42.759ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43662024-11-05T00:04:42.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43672024-11-05T00:04:42.760ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43682024-11-05T00:04:42.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43692024-11-05T00:04:42.762ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43702024-11-05T00:04:42.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43712024-11-05T00:04:42.764ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43722024-11-05T00:04:42.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
43732024-11-05T00:04:42.769ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43742024-11-05T00:04:42.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43752024-11-05T00:04:42.771ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43762024-11-05T00:04:42.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43772024-11-05T00:04:42.772ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43782024-11-05T00:04:42.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43792024-11-05T00:04:42.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43802024-11-05T00:04:42.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43812024-11-05T00:04:42.774ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43822024-11-05T00:04:42.775ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
43832024-11-05T00:04:42.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43842024-11-05T00:04:42.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43852024-11-05T00:04:42.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
43862024-11-05T00:04:42.778ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43872024-11-05T00:04:42.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43882024-11-05T00:04:42.786ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43892024-11-05T00:04:42.787ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "788ef6ca-339f-49ee-a479-ac414a24e335", "content-length": "134", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
43902024-11-05T00:04:42.787ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
43912024-11-05T00:04:42.787ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
43922024-11-05T00:04:42.787ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43932024-11-05T00:04:42.787ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43942024-11-05T00:04:42.787ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43952024-11-05T00:04:42.787ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43962024-11-05T00:04:42.787ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43972024-11-05T00:04:42.787ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43982024-11-05T00:04:42.788ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
43992024-11-05T00:04:42.788ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44002024-11-05T00:04:42.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44012024-11-05T00:04:42.789ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44022024-11-05T00:04:42.789ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44032024-11-05T00:04:42.789ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
44042024-11-05T00:04:42.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44052024-11-05T00:04:42.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44062024-11-05T00:04:42.790ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44072024-11-05T00:04:42.792ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
44082024-11-05T00:04:42.792ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44092024-11-05T00:04:42.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44102024-11-05T00:04:42.792ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44112024-11-05T00:04:42.793ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fd29466-4ea2-48fb-9527-71da36b61ace", "content-length": "2", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
44122024-11-05T00:04:42.793ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44132024-11-05T00:04:42.793ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "09535853-9920-46e9-a098-d20e0426063f", "content-length": "52", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
44142024-11-05T00:04:42.793ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
44152024-11-05T00:04:42.793ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44162024-11-05T00:04:42.794ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
44172024-11-05T00:04:42.794ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
44182024-11-05T00:04:42.794ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
44192024-11-05T00:04:42.847ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, time_created: 2024-11-04T23:54:41.796370Z, time_modified: 2024-11-04T23:54:41.796370Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
44202024-11-05T00:04:42.847ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
44212024-11-05T00:04:42.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44222024-11-05T00:04:42.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44232024-11-05T00:04:42.849ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44242024-11-05T00:04:42.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44252024-11-05T00:04:42.851ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262024-11-05T00:04:42.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
44272024-11-05T00:04:42.892ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
44282024-11-05T00:04:42.928ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a0bfe181-6f8b-4b8a-b13d-53ad79a72f75", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
44292024-11-05T00:04:42.928ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
44302024-11-05T00:04:42.928ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44312024-11-05T00:04:42.928ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "317592f5-fbcc-4de9-a376-a42196967bcf", "content-length": "682", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
44322024-11-05T00:04:42.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44332024-11-05T00:04:42.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44342024-11-05T00:04:42.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44352024-11-05T00:04:42.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44362024-11-05T00:04:42.935ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "ff306c99-12aa-4659-b01a-ac5e56087873", "date": "Tue, 05 Nov 2024 00:04:42 GMT"} })
44372024-11-05T00:04:42.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44382024-11-05T00:04:42.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44392024-11-05T00:04:42.937ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
44402024-11-05T00:04:42.937ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 764.469684ms
44412024-11-05T00:04:42.937ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 764.482593ms iteration = 3 status = {}
44422024-11-05T00:04:42.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44432024-11-05T00:04:42.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44442024-11-05T00:04:42.946ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 773.55514ms iteration = 21 status = {}
44452024-11-05T00:04:43.293ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
44462024-11-05T00:04:43.293ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44472024-11-05T00:04:43.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44482024-11-05T00:04:43.295ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44492024-11-05T00:04:43.297ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
44502024-11-05T00:04:43.297ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44512024-11-05T00:04:43.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44522024-11-05T00:04:43.474ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(459ddf92-807c-4f85-8a68-30bfe362c126, 0), (4af398d6-6ea9-4b4f-868a-548ccf890d0d, 0), (d7b4c8f1-47bb-4854-8540-e40f39a2500d, 0), (478a59bb-8bfc-46f9-8f8a-691d2aa01cfb, 0)] collection_id = 459ddf92-807c-4f85-8a68-30bfe362c126
44532024-11-05T00:04:43.474ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44542024-11-05T00:04:43.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44552024-11-05T00:04:43.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58eaaf0c-485f-49ed-b98f-71dcd5038ef2 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
44562024-11-05T00:04:43.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58eaaf0c-485f-49ed-b98f-71dcd5038ef2 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
44572024-11-05T00:04:43.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58eaaf0c-485f-49ed-b98f-71dcd5038ef2 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
44582024-11-05T00:04:43.538ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 459ddf92-807c-4f85-8a68-30bfe362c126 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
44592024-11-05T00:04:43.538ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44602024-11-05T00:04:43.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44612024-11-05T00:04:43.549ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(4af398d6-6ea9-4b4f-868a-548ccf890d0d, 0), (d7b4c8f1-47bb-4854-8540-e40f39a2500d, 0), (478a59bb-8bfc-46f9-8f8a-691d2aa01cfb, 0), (65a55bb5-7ecd-43c9-be7f-c779577fb2fe, 0)] collection_id = 4af398d6-6ea9-4b4f-868a-548ccf890d0d
44622024-11-05T00:04:43.549ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44632024-11-05T00:04:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44642024-11-05T00:04:43.597ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 4af398d6-6ea9-4b4f-868a-548ccf890d0d file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
44652024-11-05T00:04:43.597ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44662024-11-05T00:04:43.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44672024-11-05T00:04:43.601ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(d7b4c8f1-47bb-4854-8540-e40f39a2500d, 0), (478a59bb-8bfc-46f9-8f8a-691d2aa01cfb, 0), (65a55bb5-7ecd-43c9-be7f-c779577fb2fe, 0)]
44682024-11-05T00:04:43.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2927, tv_nsec: 188610832 } })
44692024-11-05T00:04:43.632ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
44702024-11-05T00:04:43.632ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
44712024-11-05T00:04:43.632ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
44722024-11-05T00:04:43.632ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6d18660-429e-45b0-9d0d-23959e7fc175", "content-length": "476", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44732024-11-05T00:04:43.632ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
44742024-11-05T00:04:43.633ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "86239d52-a500-4adc-b25a-7aec5c344720", "content-length": "734", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44752024-11-05T00:04:43.633ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
44762024-11-05T00:04:43.633ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dafe3bbf-4daa-48ba-a600-bac8ff0c03a8", "content-length": "111", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44772024-11-05T00:04:43.633ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
44782024-11-05T00:04:43.633ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "92549568-17a9-47a8-813a-9c1ce2ecb3ad", "content-length": "111", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44792024-11-05T00:04:43.633ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
44802024-11-05T00:04:43.633ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb48b02c-bb69-4c40-a506-1ed300a39c90", "content-length": "167", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44812024-11-05T00:04:43.633ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
44822024-11-05T00:04:43.634ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dca1603-1686-4350-a66e-ef7ca5146db7", "content-length": "167", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44832024-11-05T00:04:43.634ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
44842024-11-05T00:04:43.634ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c81e6141-3ad9-4f1a-a1fb-814f543c982c", "content-length": "175", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44852024-11-05T00:04:43.634ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
44862024-11-05T00:04:43.634ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "adb854e6-afc2-47a0-929e-c13c699797a5", "content-length": "175", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44872024-11-05T00:04:43.634ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
44882024-11-05T00:04:43.634ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "179dee8f-5bd1-4d5d-b5bb-4bb762ad0045", "content-length": "702", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44892024-11-05T00:04:43.634ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
44902024-11-05T00:04:43.634ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba5b490e-f0c0-49e9-ad13-71d3f9f51847", "content-length": "727", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44912024-11-05T00:04:43.634ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
44922024-11-05T00:04:43.635ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dba893d-ba5e-42ba-b198-36ce7ef51422", "content-length": "729", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44932024-11-05T00:04:43.635ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
44942024-11-05T00:04:43.635ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e4ae4a3-46d3-455b-8ae1-7de11b0c79d4", "content-length": "728", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44952024-11-05T00:04:43.635ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
44962024-11-05T00:04:43.635ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c28641ba-df58-4a4f-b4c5-a1e804ee21cf", "content-length": "722", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44972024-11-05T00:04:43.635ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
44982024-11-05T00:04:43.635ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b9915fa-da23-4a3f-b4cf-addb493e0f7b", "content-length": "109", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
44992024-11-05T00:04:43.635ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
45002024-11-05T00:04:43.635ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "769dd103-a0d4-4899-b904-2e16e42f8430", "content-length": "109", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
45012024-11-05T00:04:43.635ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
45022024-11-05T00:04:43.636ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fcc8c9a-9a2d-4e9c-9480-2c6900c9c7c4", "content-length": "169", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
45032024-11-05T00:04:43.636ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
45042024-11-05T00:04:43.636ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "16cd01a3-4aca-40a4-98db-2ee34f955d0d", "content-length": "169", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
45052024-11-05T00:04:43.636ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
45062024-11-05T00:04:43.636ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "85e36497-8c7d-469e-abaa-566a29784ca3", "content-length": "178", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
45072024-11-05T00:04:43.636ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
45082024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2ce3875-c809-4955-9dc5-e347aaa6872c", "content-length": "178", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
45092024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
45102024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "256d8278-b5d7-4f35-954b-a0ff760e0b49", "content-length": "702", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
45112024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
45122024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "36c93f1b-3bb4-4a01-ad17-18585cf5e371", "content-length": "727", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
45132024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
45142024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddca227b-782c-41d0-81b6-cc513fa982b9", "content-length": "729", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
45152024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
45162024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "be6be253-06fd-4be4-9bd2-814a806c85b3", "content-length": "728", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
45172024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45182024-11-05T00:04:43.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45192024-11-05T00:04:43.639ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45202024-11-05T00:04:43.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
45212024-11-05T00:04:43.640ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45222024-11-05T00:04:43.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45232024-11-05T00:04:43.642ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45242024-11-05T00:04:43.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
45252024-11-05T00:04:43.644ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45262024-11-05T00:04:43.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45272024-11-05T00:04:43.729ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
45282024-11-05T00:04:43.729ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
45292024-11-05T00:04:43.948ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b05a690-22b8-498a-bc48-dc967ee9687c", "content-length": "29196", "date": "Tue, 05 Nov 2024 00:04:43 GMT"} })
45302024-11-05T00:04:43.950ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
45312024-11-05T00:04:43.952ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45322024-11-05T00:04:43.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45332024-11-05T00:04:43.954ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45342024-11-05T00:04:43.956ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
45352024-11-05T00:04:43.956ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45362024-11-05T00:04:43.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45372024-11-05T00:04:44.105ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 413b1f44-c6cc-496e-8cb3-63c98a505baa file = nexus/db-queries/src/db/datastore/inventory.rs:1000
45382024-11-05T00:04:44.105ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 413b1f44-c6cc-496e-8cb3-63c98a505baa time_started = 2024-11-05 00:04:43.632282 UTC
45392024-11-05T00:04:44.105ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 811.438737ms iteration = 3 status = {"collection_id":"413b1f44-c6cc-496e-8cb3-63c98a505baa","time_done":"2024-11-05 00:04:43.950754 UTC","time_started":"2024-11-05 00:04:43.632282 UTC"}
45402024-11-05T00:04:44.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
45412024-11-05T00:04:44.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45422024-11-05T00:04:44.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45432024-11-05T00:04:44.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45442024-11-05T00:04:44.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45452024-11-05T00:04:44.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45462024-11-05T00:04:44.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45472024-11-05T00:04:44.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45482024-11-05T00:04:44.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45492024-11-05T00:04:44.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45502024-11-05T00:04:44.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45512024-11-05T00:04:44.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45522024-11-05T00:04:44.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45532024-11-05T00:04:44.149ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 44.808909ms iteration = 24 status = {"physical_disks_added":0}
45542024-11-05T00:04:44.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b56067a0-fe45-4977-83bd-8c2de8abf32c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45552024-11-05T00:04:44.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b56067a0-fe45-4977-83bd-8c2de8abf32c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45562024-11-05T00:04:44.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b56067a0-fe45-4977-83bd-8c2de8abf32c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45572024-11-05T00:04:45.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ecd919c0-3f79-48da-946e-a8c5dacf59f7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45582024-11-05T00:04:45.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ecd919c0-3f79-48da-946e-a8c5dacf59f7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45592024-11-05T00:04:45.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ecd919c0-3f79-48da-946e-a8c5dacf59f7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45602024-11-05T00:04:46.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = aa6d43a1-d7b3-478b-8ac5-b030332e9f43 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45612024-11-05T00:04:46.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = aa6d43a1-d7b3-478b-8ac5-b030332e9f43 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45622024-11-05T00:04:46.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1983 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = aa6d43a1-d7b3-478b-8ac5-b030332e9f43 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45632024-11-05T00:04:47.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 00e2e2a1-7fe8-4d57-92b6-dfe456c3875d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45642024-11-05T00:04:47.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 00e2e2a1-7fe8-4d57-92b6-dfe456c3875d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45652024-11-05T00:04:47.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 00e2e2a1-7fe8-4d57-92b6-dfe456c3875d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45662024-11-05T00:04:48.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4809484b-49b7-42c1-b489-d051d0f096bf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45672024-11-05T00:04:48.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4809484b-49b7-42c1-b489-d051d0f096bf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45682024-11-05T00:04:48.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4809484b-49b7-42c1-b489-d051d0f096bf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45692024-11-05T00:04:49.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 40ba9684-761a-4384-9bdf-24a09970f2c8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45702024-11-05T00:04:49.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 40ba9684-761a-4384-9bdf-24a09970f2c8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45712024-11-05T00:04:49.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 40ba9684-761a-4384-9bdf-24a09970f2c8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45722024-11-05T00:04:50.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dea196c9-2bb3-4dc1-9b7f-b2d206e2cfe2 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45732024-11-05T00:04:50.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dea196c9-2bb3-4dc1-9b7f-b2d206e2cfe2 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45742024-11-05T00:04:50.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dea196c9-2bb3-4dc1-9b7f-b2d206e2cfe2 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45752024-11-05T00:04:51.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 73441454-6bbb-46cd-af25-47fb79b08ff7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45762024-11-05T00:04:51.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 73441454-6bbb-46cd-af25-47fb79b08ff7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45772024-11-05T00:04:51.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 73441454-6bbb-46cd-af25-47fb79b08ff7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
45782024-11-05T00:04:51.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 463 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = d7d392da-aaae-4faa-b311-f33142e5a00f response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
45792024-11-05T00:04:52.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
45802024-11-05T00:04:52.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
45812024-11-05T00:04:52.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45822024-11-05T00:04:52.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45832024-11-05T00:04:52.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45842024-11-05T00:04:52.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45852024-11-05T00:04:52.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45862024-11-05T00:04:52.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45872024-11-05T00:04:52.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45882024-11-05T00:04:52.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.093814ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45892024-11-05T00:04:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45902024-11-05T00:04:52.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45912024-11-05T00:04:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45922024-11-05T00:04:52.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45932024-11-05T00:04:52.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45942024-11-05T00:04:52.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45952024-11-05T00:04:52.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
45962024-11-05T00:04:52.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45972024-11-05T00:04:52.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45982024-11-05T00:04:52.192ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
45992024-11-05T00:04:52.192ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.113093ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
46002024-11-05T00:04:52.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 55b5c21b-4b93-47db-9310-fbcd2cf1b4d5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46012024-11-05T00:04:52.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 55b5c21b-4b93-47db-9310-fbcd2cf1b4d5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46022024-11-05T00:04:52.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 55b5c21b-4b93-47db-9310-fbcd2cf1b4d5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46032024-11-05T00:04:53.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d8c5d5bb-1f3b-4cc4-9fb0-d65c48713617 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46042024-11-05T00:04:53.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d8c5d5bb-1f3b-4cc4-9fb0-d65c48713617 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46052024-11-05T00:04:53.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d8c5d5bb-1f3b-4cc4-9fb0-d65c48713617 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46062024-11-05T00:04:54.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b8bb6c47-312d-4763-b344-3ed6bd02eb26 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46072024-11-05T00:04:54.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b8bb6c47-312d-4763-b344-3ed6bd02eb26 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46082024-11-05T00:04:54.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b8bb6c47-312d-4763-b344-3ed6bd02eb26 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46092024-11-05T00:04:55.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 16e90bc1-5ad0-48d7-9485-75715fba8c36 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46102024-11-05T00:04:55.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 16e90bc1-5ad0-48d7-9485-75715fba8c36 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46112024-11-05T00:04:55.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 16e90bc1-5ad0-48d7-9485-75715fba8c36 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46122024-11-05T00:04:56.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d8366b59-1c86-47ad-a50c-265212141e21 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46132024-11-05T00:04:56.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d8366b59-1c86-47ad-a50c-265212141e21 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46142024-11-05T00:04:56.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d8366b59-1c86-47ad-a50c-265212141e21 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46152024-11-05T00:04:57.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d6b61fd5-e31a-4808-8ae3-ebba7aa753bf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46162024-11-05T00:04:57.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d6b61fd5-e31a-4808-8ae3-ebba7aa753bf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46172024-11-05T00:04:57.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d6b61fd5-e31a-4808-8ae3-ebba7aa753bf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46182024-11-05T00:04:58.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 70fb9b63-1ddb-407d-86cc-29d80c513f41 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46192024-11-05T00:04:58.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 70fb9b63-1ddb-407d-86cc-29d80c513f41 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46202024-11-05T00:04:58.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 70fb9b63-1ddb-407d-86cc-29d80c513f41 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46212024-11-05T00:04:59.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f6cd1a7c-3746-4fb1-87f5-321218d56485 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46222024-11-05T00:04:59.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f6cd1a7c-3746-4fb1-87f5-321218d56485 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46232024-11-05T00:04:59.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f6cd1a7c-3746-4fb1-87f5-321218d56485 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46242024-11-05T00:05:00.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cc1cc417-db76-41a9-b070-3b097d40d488 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46252024-11-05T00:05:00.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cc1cc417-db76-41a9-b070-3b097d40d488 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46262024-11-05T00:05:00.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cc1cc417-db76-41a9-b070-3b097d40d488 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46272024-11-05T00:05:01.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4f6bd4a0-e831-4115-aba0-8d296cd2ebdd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46282024-11-05T00:05:01.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4f6bd4a0-e831-4115-aba0-8d296cd2ebdd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46292024-11-05T00:05:01.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4f6bd4a0-e831-4115-aba0-8d296cd2ebdd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46302024-11-05T00:05:02.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
46312024-11-05T00:05:02.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46322024-11-05T00:05:02.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
46332024-11-05T00:05:02.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46342024-11-05T00:05:02.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46352024-11-05T00:05:02.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46362024-11-05T00:05:02.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46372024-11-05T00:05:02.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46382024-11-05T00:05:02.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46392024-11-05T00:05:02.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46402024-11-05T00:05:02.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46412024-11-05T00:05:02.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46422024-11-05T00:05:02.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46432024-11-05T00:05:02.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46442024-11-05T00:05:02.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46452024-11-05T00:05:02.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
46462024-11-05T00:05:02.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46472024-11-05T00:05:02.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46482024-11-05T00:05:02.194ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
46492024-11-05T00:05:02.195ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.648105ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
46502024-11-05T00:05:02.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.292845ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46512024-11-05T00:05:02.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 06141ce2-2490-47d5-9331-fa161e4abcc8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46522024-11-05T00:05:02.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 06141ce2-2490-47d5-9331-fa161e4abcc8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46532024-11-05T00:05:02.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1689 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 06141ce2-2490-47d5-9331-fa161e4abcc8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46542024-11-05T00:05:04.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e028f570-cd4e-49e9-8e86-da6d0ad374ea roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46552024-11-05T00:05:04.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e028f570-cd4e-49e9-8e86-da6d0ad374ea resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46562024-11-05T00:05:04.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e028f570-cd4e-49e9-8e86-da6d0ad374ea response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46572024-11-05T00:05:05.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 30f9baa8-037a-49ba-b783-428130039639 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46582024-11-05T00:05:05.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 30f9baa8-037a-49ba-b783-428130039639 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46592024-11-05T00:05:05.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 30f9baa8-037a-49ba-b783-428130039639 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46602024-11-05T00:05:06.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fdfebc20-3dd8-4bc9-a8a4-1cbc33bd396a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46612024-11-05T00:05:06.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fdfebc20-3dd8-4bc9-a8a4-1cbc33bd396a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46622024-11-05T00:05:06.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fdfebc20-3dd8-4bc9-a8a4-1cbc33bd396a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46632024-11-05T00:05:06.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 440 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 2145aa23-278e-48db-aad5-6e03aec6a1ae response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
46642024-11-05T00:05:07.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8ebf7de8-3246-471e-b264-b67804e6aca9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46652024-11-05T00:05:07.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8ebf7de8-3246-471e-b264-b67804e6aca9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46662024-11-05T00:05:07.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8ebf7de8-3246-471e-b264-b67804e6aca9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46672024-11-05T00:05:08.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = acb99ae5-e7f9-42e5-8e4c-40b783cf7031 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46682024-11-05T00:05:08.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = acb99ae5-e7f9-42e5-8e4c-40b783cf7031 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46692024-11-05T00:05:08.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = acb99ae5-e7f9-42e5-8e4c-40b783cf7031 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46702024-11-05T00:05:09.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8bec6148-fd4e-479f-b26d-63bfc28ac25c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46712024-11-05T00:05:09.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8bec6148-fd4e-479f-b26d-63bfc28ac25c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46722024-11-05T00:05:09.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8bec6148-fd4e-479f-b26d-63bfc28ac25c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46732024-11-05T00:05:10.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6077539-0c77-4521-ae32-99ff3113ac01 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46742024-11-05T00:05:10.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6077539-0c77-4521-ae32-99ff3113ac01 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46752024-11-05T00:05:10.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6077539-0c77-4521-ae32-99ff3113ac01 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46762024-11-05T00:05:11.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 11a9a89d-8886-4ad7-bc44-664c8f714d41 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46772024-11-05T00:05:11.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 11a9a89d-8886-4ad7-bc44-664c8f714d41 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46782024-11-05T00:05:11.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 11a9a89d-8886-4ad7-bc44-664c8f714d41 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
46792024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
46802024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46812024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
46822024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
46832024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46842024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46852024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46862024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
46872024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
46882024-11-05T00:05:12.172ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46892024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46902024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46912024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
46922024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
46932024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
46942024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
46952024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46962024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46972024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46982024-11-05T00:05:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
46992024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47002024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
47012024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47022024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
47032024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47042024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
47052024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47062024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
47072024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.83\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
47082024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
47092024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
47102024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.151\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47112024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
47122024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 18.041\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47132024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.02\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
47142024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47152024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47162024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47172024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47182024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47192024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47202024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47212024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47222024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47232024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47242024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47252024-11-05T00:05:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47262024-11-05T00:05:12.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2955, tv_nsec: 762310584 } })
47272024-11-05T00:05:12.176ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
47282024-11-05T00:05:12.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47292024-11-05T00:05:12.176ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.727337ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47302024-11-05T00:05:12.176ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47312024-11-05T00:05:12.176ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47322024-11-05T00:05:12.177ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47332024-11-05T00:05:12.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47342024-11-05T00:05:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47352024-11-05T00:05:12.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47362024-11-05T00:05:12.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47372024-11-05T00:05:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47382024-11-05T00:05:12.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47392024-11-05T00:05:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47402024-11-05T00:05:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47412024-11-05T00:05:12.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47422024-11-05T00:05:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47432024-11-05T00:05:12.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47442024-11-05T00:05:12.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47452024-11-05T00:05:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47462024-11-05T00:05:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47472024-11-05T00:05:12.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47482024-11-05T00:05:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47492024-11-05T00:05:12.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47502024-11-05T00:05:12.182ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47512024-11-05T00:05:12.183ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2955, tv_nsec: 769449430 } })
47522024-11-05T00:05:12.183ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
47532024-11-05T00:05:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47542024-11-05T00:05:12.184ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47552024-11-05T00:05:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47562024-11-05T00:05:12.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47572024-11-05T00:05:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47582024-11-05T00:05:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47592024-11-05T00:05:12.185ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2955, tv_nsec: 771536353 } })
47602024-11-05T00:05:12.185ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
47612024-11-05T00:05:12.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47622024-11-05T00:05:12.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47632024-11-05T00:05:12.188ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47642024-11-05T00:05:12.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47652024-11-05T00:05:12.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47662024-11-05T00:05:12.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47672024-11-05T00:05:12.190ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47682024-11-05T00:05:12.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47692024-11-05T00:05:12.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47702024-11-05T00:05:12.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47712024-11-05T00:05:12.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47722024-11-05T00:05:12.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47732024-11-05T00:05:12.192ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47742024-11-05T00:05:12.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47752024-11-05T00:05:12.195ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47762024-11-05T00:05:12.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47772024-11-05T00:05:12.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47782024-11-05T00:05:12.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47792024-11-05T00:05:12.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 31e4cf64-6536-4d63-80a5-209fcf02c06a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
47802024-11-05T00:05:12.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 31e4cf64-6536-4d63-80a5-209fcf02c06a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
47812024-11-05T00:05:12.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 31e4cf64-6536-4d63-80a5-209fcf02c06a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
47822024-11-05T00:05:12.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47832024-11-05T00:05:12.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47842024-11-05T00:05:12.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47852024-11-05T00:05:12.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47862024-11-05T00:05:12.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47872024-11-05T00:05:12.226ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47882024-11-05T00:05:12.226ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47892024-11-05T00:05:12.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47902024-11-05T00:05:12.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47912024-11-05T00:05:12.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
47922024-11-05T00:05:12.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47932024-11-05T00:05:12.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47942024-11-05T00:05:12.229ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47952024-11-05T00:05:12.230ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47962024-11-05T00:05:12.230ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 57.130823ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47972024-11-05T00:05:12.231ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47982024-11-05T00:05:12.231ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.641733ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47992024-11-05T00:05:12.231ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.606243ms iteration = 22 status = 0
48002024-11-05T00:05:12.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48012024-11-05T00:05:12.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48022024-11-05T00:05:12.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.207907ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48032024-11-05T00:05:12.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48042024-11-05T00:05:12.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48052024-11-05T00:05:12.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48062024-11-05T00:05:12.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
48072024-11-05T00:05:12.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48082024-11-05T00:05:12.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48092024-11-05T00:05:12.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.605991ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48102024-11-05T00:05:12.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48112024-11-05T00:05:12.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48122024-11-05T00:05:12.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48132024-11-05T00:05:12.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48142024-11-05T00:05:12.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48152024-11-05T00:05:12.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48162024-11-05T00:05:12.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48172024-11-05T00:05:12.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48182024-11-05T00:05:12.257ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
48192024-11-05T00:05:12.257ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48202024-11-05T00:05:12.257ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc7b793d-a8d0-4f67-a31e-4d184c3e3ec1", "content-length": "26", "date": "Tue, 05 Nov 2024 00:05:12 GMT"} })
48212024-11-05T00:05:12.257ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48222024-11-05T00:05:12.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
48232024-11-05T00:05:12.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.25489ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
48242024-11-05T00:05:12.258ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48252024-11-05T00:05:12.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
48262024-11-05T00:05:12.275ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48272024-11-05T00:05:12.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
48282024-11-05T00:05:12.275ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48292024-11-05T00:05:12.275ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "267bf566-a192-46e8-a4c3-0d5679f842ae", "content-length": "26", "date": "Tue, 05 Nov 2024 00:05:12 GMT"} })
48302024-11-05T00:05:12.275ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48312024-11-05T00:05:12.275ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6e76782-a116-4727-bcfc-419f940363cb", "content-length": "26", "date": "Tue, 05 Nov 2024 00:05:12 GMT"} })
48322024-11-05T00:05:12.275ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48332024-11-05T00:05:12.277ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
48342024-11-05T00:05:12.278ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48352024-11-05T00:05:12.308ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 135.411779ms iteration = 25 status = {"physical_disks_added":0}
48362024-11-05T00:05:12.379ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48372024-11-05T00:05:12.380ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "19122335-1348-4d63-8224-9cc0da0512a1", "content-length": "691", "date": "Tue, 05 Nov 2024 00:05:12 GMT"} })
48382024-11-05T00:05:12.380ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
48392024-11-05T00:05:12.380ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
48402024-11-05T00:05:12.380ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
48412024-11-05T00:05:12.382ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 209.297976ms iteration = 22 status = {}
48422024-11-05T00:05:12.388ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48432024-11-05T00:05:12.388ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cd00f18-bc3e-4eff-8f42-05952b724189", "content-length": "1", "date": "Tue, 05 Nov 2024 00:05:11 GMT"} })
48442024-11-05T00:05:12.390ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48452024-11-05T00:05:12.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48462024-11-05T00:05:12.392ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.584327ms iteration = 22 status = null
48472024-11-05T00:05:12.398ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48482024-11-05T00:05:12.398ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48492024-11-05T00:05:12.398ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a2e0781-2190-492e-9081-6087ee422cec", "content-length": "372", "date": "Tue, 05 Nov 2024 00:05:12 GMT"} })
48502024-11-05T00:05:12.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48512024-11-05T00:05:12.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48522024-11-05T00:05:12.402ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 229.884198ms iteration = 22 status = {}
48532024-11-05T00:05:12.453ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
48542024-11-05T00:05:12.453ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48552024-11-05T00:05:12.453ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d11ebbde-4715-4614-ba73-be8110ddfffb", "date": "Tue, 05 Nov 2024 00:05:12 GMT"} })
48562024-11-05T00:05:12.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48572024-11-05T00:05:12.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48582024-11-05T00:05:12.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48592024-11-05T00:05:12.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48602024-11-05T00:05:12.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48612024-11-05T00:05:12.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48622024-11-05T00:05:12.469ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48632024-11-05T00:05:12.469ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48642024-11-05T00:05:12.469ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "33a2dc54-7aa4-4937-a111-29e5ac52ede6", "date": "Tue, 05 Nov 2024 00:05:12 GMT"} })
48652024-11-05T00:05:12.471ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 298.937416ms iteration = 22 status = {}
48662024-11-05T00:05:12.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48672024-11-05T00:05:12.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48682024-11-05T00:05:12.474ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
48692024-11-05T00:05:12.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48702024-11-05T00:05:12.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48712024-11-05T00:05:12.489ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48722024-11-05T00:05:12.489ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1be88618-3d21-4c58-8fd4-60c0b296e29e", "content-length": "134", "date": "Tue, 05 Nov 2024 00:05:11 GMT"} })
48732024-11-05T00:05:12.489ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48742024-11-05T00:05:12.489ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
48752024-11-05T00:05:12.489ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48762024-11-05T00:05:12.489ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48772024-11-05T00:05:12.489ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48782024-11-05T00:05:12.489ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48792024-11-05T00:05:12.489ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48802024-11-05T00:05:12.489ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48812024-11-05T00:05:12.489ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48822024-11-05T00:05:12.489ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48832024-11-05T00:05:12.490ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
48842024-11-05T00:05:12.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48852024-11-05T00:05:12.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48862024-11-05T00:05:12.497ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48872024-11-05T00:05:12.497ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dbdad1e-0fa7-4116-baf9-7a99fbc96440", "content-length": "2", "date": "Tue, 05 Nov 2024 00:05:11 GMT"} })
48882024-11-05T00:05:12.497ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48892024-11-05T00:05:12.497ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "47ea6a6b-03e2-4584-93c9-c26b9e2429fb", "content-length": "52", "date": "Tue, 05 Nov 2024 00:05:11 GMT"} })
48902024-11-05T00:05:12.497ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
48912024-11-05T00:05:12.497ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48922024-11-05T00:05:12.615ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "60de4ff5-441b-4eac-a372-902a6c6de2b8", "date": "Tue, 05 Nov 2024 00:05:12 GMT"} })
48932024-11-05T00:05:12.615ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
48942024-11-05T00:05:12.615ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48952024-11-05T00:05:12.620ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e6d5883-5c54-42ab-9c0a-7c37d0f5cca3", "content-length": "682", "date": "Tue, 05 Nov 2024 00:05:12 GMT"} })
48962024-11-05T00:05:12.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48972024-11-05T00:05:12.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48982024-11-05T00:05:12.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48992024-11-05T00:05:12.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49002024-11-05T00:05:12.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49012024-11-05T00:05:12.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49022024-11-05T00:05:12.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49032024-11-05T00:05:12.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49042024-11-05T00:05:12.637ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 464.620197ms iteration = 22 status = {}
49052024-11-05T00:05:13.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a6d79546-20c6-4e1c-8495-22558d943d22 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49062024-11-05T00:05:13.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a6d79546-20c6-4e1c-8495-22558d943d22 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49072024-11-05T00:05:13.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a6d79546-20c6-4e1c-8495-22558d943d22 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49082024-11-05T00:05:14.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f3ce0371-a061-4215-9831-942e4db90b73 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49092024-11-05T00:05:14.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f3ce0371-a061-4215-9831-942e4db90b73 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49102024-11-05T00:05:14.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f3ce0371-a061-4215-9831-942e4db90b73 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49112024-11-05T00:05:15.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2d86216-75cf-4dbc-a28e-32814921526f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49122024-11-05T00:05:15.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2d86216-75cf-4dbc-a28e-32814921526f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49132024-11-05T00:05:15.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2d86216-75cf-4dbc-a28e-32814921526f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49142024-11-05T00:05:16.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 60a37502-4187-4181-9826-951f03f2123f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49152024-11-05T00:05:16.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 60a37502-4187-4181-9826-951f03f2123f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49162024-11-05T00:05:16.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 60a37502-4187-4181-9826-951f03f2123f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49172024-11-05T00:05:17.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8e814aa7-9ab6-475d-980b-9737165d0af6 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49182024-11-05T00:05:17.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8e814aa7-9ab6-475d-980b-9737165d0af6 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49192024-11-05T00:05:17.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8e814aa7-9ab6-475d-980b-9737165d0af6 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49202024-11-05T00:05:18.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d294fd1-01b8-4a15-96c9-a180f6afab7f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49212024-11-05T00:05:18.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d294fd1-01b8-4a15-96c9-a180f6afab7f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49222024-11-05T00:05:18.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d294fd1-01b8-4a15-96c9-a180f6afab7f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49232024-11-05T00:05:19.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7497c956-3121-4326-9fa7-9e6838dd9682 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49242024-11-05T00:05:19.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7497c956-3121-4326-9fa7-9e6838dd9682 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49252024-11-05T00:05:19.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7497c956-3121-4326-9fa7-9e6838dd9682 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49262024-11-05T00:05:20.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 552b3f04-e834-4607-8ba9-f6c0eb181acf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49272024-11-05T00:05:20.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 552b3f04-e834-4607-8ba9-f6c0eb181acf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49282024-11-05T00:05:20.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 552b3f04-e834-4607-8ba9-f6c0eb181acf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49292024-11-05T00:05:21.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c81b72f7-85e7-46c8-863f-7d7c3139a861 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49302024-11-05T00:05:21.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c81b72f7-85e7-46c8-863f-7d7c3139a861 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49312024-11-05T00:05:21.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c81b72f7-85e7-46c8-863f-7d7c3139a861 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49322024-11-05T00:05:21.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 823 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = f1000cc7-51ab-4324-b851-fa6ce40dc7f1 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
49332024-11-05T00:05:22.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
49342024-11-05T00:05:22.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49352024-11-05T00:05:22.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
49362024-11-05T00:05:22.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49372024-11-05T00:05:22.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49382024-11-05T00:05:22.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49392024-11-05T00:05:22.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49402024-11-05T00:05:22.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49412024-11-05T00:05:22.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49422024-11-05T00:05:22.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.187935ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49432024-11-05T00:05:22.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49442024-11-05T00:05:22.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49452024-11-05T00:05:22.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49462024-11-05T00:05:22.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49472024-11-05T00:05:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49482024-11-05T00:05:22.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49492024-11-05T00:05:22.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
49502024-11-05T00:05:22.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49512024-11-05T00:05:22.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49522024-11-05T00:05:22.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
49532024-11-05T00:05:22.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.537221ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
49542024-11-05T00:05:22.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 45c316f0-6abe-4e6e-bece-2a793e8fb16e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49552024-11-05T00:05:22.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 45c316f0-6abe-4e6e-bece-2a793e8fb16e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49562024-11-05T00:05:22.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 45c316f0-6abe-4e6e-bece-2a793e8fb16e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49572024-11-05T00:05:23.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4bb2f9d7-af15-4be2-88e0-78f83becb8ff roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49582024-11-05T00:05:23.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4bb2f9d7-af15-4be2-88e0-78f83becb8ff resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49592024-11-05T00:05:23.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4bb2f9d7-af15-4be2-88e0-78f83becb8ff response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49602024-11-05T00:05:24.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2781b6da-11df-4a9b-a2c1-f09fb70565e3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49612024-11-05T00:05:24.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2781b6da-11df-4a9b-a2c1-f09fb70565e3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49622024-11-05T00:05:24.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2781b6da-11df-4a9b-a2c1-f09fb70565e3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49632024-11-05T00:05:25.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 190818af-1395-45ed-9b59-cd4dad1ac108 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49642024-11-05T00:05:25.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 190818af-1395-45ed-9b59-cd4dad1ac108 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49652024-11-05T00:05:25.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 190818af-1395-45ed-9b59-cd4dad1ac108 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49662024-11-05T00:05:26.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c5193b5b-078e-4ab8-8c61-67f27774d203 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49672024-11-05T00:05:26.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c5193b5b-078e-4ab8-8c61-67f27774d203 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49682024-11-05T00:05:26.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c5193b5b-078e-4ab8-8c61-67f27774d203 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49692024-11-05T00:05:27.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 253f5750-3c85-4ecd-a282-0696af7322d5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49702024-11-05T00:05:27.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 253f5750-3c85-4ecd-a282-0696af7322d5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49712024-11-05T00:05:27.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 253f5750-3c85-4ecd-a282-0696af7322d5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49722024-11-05T00:05:28.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ebb7a155-2e09-4051-971c-7ed33b7c8751 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49732024-11-05T00:05:28.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ebb7a155-2e09-4051-971c-7ed33b7c8751 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49742024-11-05T00:05:28.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ebb7a155-2e09-4051-971c-7ed33b7c8751 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49752024-11-05T00:05:29.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e1717981-d8c3-45c6-ac0e-c59241ff3708 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49762024-11-05T00:05:29.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e1717981-d8c3-45c6-ac0e-c59241ff3708 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49772024-11-05T00:05:29.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e1717981-d8c3-45c6-ac0e-c59241ff3708 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49782024-11-05T00:05:30.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c61d781a-9a90-4c0a-924f-d87f2147736d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49792024-11-05T00:05:30.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c61d781a-9a90-4c0a-924f-d87f2147736d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49802024-11-05T00:05:30.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c61d781a-9a90-4c0a-924f-d87f2147736d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49812024-11-05T00:05:31.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f1155277-49a3-41ce-974b-c48ee3b606a6 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49822024-11-05T00:05:31.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f1155277-49a3-41ce-974b-c48ee3b606a6 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49832024-11-05T00:05:31.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f1155277-49a3-41ce-974b-c48ee3b606a6 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
49842024-11-05T00:05:32.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
49852024-11-05T00:05:32.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49862024-11-05T00:05:32.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
49872024-11-05T00:05:32.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49882024-11-05T00:05:32.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49892024-11-05T00:05:32.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49902024-11-05T00:05:32.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49912024-11-05T00:05:32.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49922024-11-05T00:05:32.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49932024-11-05T00:05:32.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.605524ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49942024-11-05T00:05:32.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49952024-11-05T00:05:32.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49962024-11-05T00:05:32.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49972024-11-05T00:05:32.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49982024-11-05T00:05:32.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49992024-11-05T00:05:32.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50002024-11-05T00:05:32.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
50012024-11-05T00:05:32.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50022024-11-05T00:05:32.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50032024-11-05T00:05:32.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
50042024-11-05T00:05:32.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.395399ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
50052024-11-05T00:05:32.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 73ce9335-efd5-43fb-9e39-a18446552e93 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50062024-11-05T00:05:32.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 73ce9335-efd5-43fb-9e39-a18446552e93 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50072024-11-05T00:05:32.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 73ce9335-efd5-43fb-9e39-a18446552e93 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50082024-11-05T00:05:33.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 688728ed-7c9f-4b9c-82f9-82c7dbba4881 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50092024-11-05T00:05:33.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 688728ed-7c9f-4b9c-82f9-82c7dbba4881 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50102024-11-05T00:05:33.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 688728ed-7c9f-4b9c-82f9-82c7dbba4881 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50112024-11-05T00:05:34.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5b51c0b7-f603-4f28-96b7-486e0daff2cf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50122024-11-05T00:05:34.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5b51c0b7-f603-4f28-96b7-486e0daff2cf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50132024-11-05T00:05:34.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5b51c0b7-f603-4f28-96b7-486e0daff2cf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50142024-11-05T00:05:35.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 36c979b4-f400-43c0-bdfe-48dd504f50ef roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50152024-11-05T00:05:35.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 36c979b4-f400-43c0-bdfe-48dd504f50ef resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50162024-11-05T00:05:35.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 36c979b4-f400-43c0-bdfe-48dd504f50ef response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50172024-11-05T00:05:36.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = abda69a1-1e11-4353-aeb2-0c47526e0467 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50182024-11-05T00:05:36.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = abda69a1-1e11-4353-aeb2-0c47526e0467 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50192024-11-05T00:05:36.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = abda69a1-1e11-4353-aeb2-0c47526e0467 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50202024-11-05T00:05:36.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 687 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 0357ebe2-5911-4347-b52f-3b3e75a554ba response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
50212024-11-05T00:05:37.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5c9156a4-54b0-4f87-90ed-7deddf3e7e64 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50222024-11-05T00:05:37.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5c9156a4-54b0-4f87-90ed-7deddf3e7e64 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50232024-11-05T00:05:37.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5c9156a4-54b0-4f87-90ed-7deddf3e7e64 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50242024-11-05T00:05:38.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9b937a14-7e38-4751-80ad-384b764c7633 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50252024-11-05T00:05:38.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9b937a14-7e38-4751-80ad-384b764c7633 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50262024-11-05T00:05:38.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9b937a14-7e38-4751-80ad-384b764c7633 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50272024-11-05T00:05:39.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a1701e05-6265-4200-97d7-afaa9134d6a9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50282024-11-05T00:05:39.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a1701e05-6265-4200-97d7-afaa9134d6a9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50292024-11-05T00:05:39.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a1701e05-6265-4200-97d7-afaa9134d6a9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50302024-11-05T00:05:40.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 11386758-a15a-494e-bd65-20e8dc428c3c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50312024-11-05T00:05:40.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 11386758-a15a-494e-bd65-20e8dc428c3c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50322024-11-05T00:05:40.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 11386758-a15a-494e-bd65-20e8dc428c3c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50332024-11-05T00:05:41.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 011d700e-28a3-4247-8daa-bed65847b67f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50342024-11-05T00:05:41.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 011d700e-28a3-4247-8daa-bed65847b67f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50352024-11-05T00:05:41.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 011d700e-28a3-4247-8daa-bed65847b67f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
50362024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
50372024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
50382024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50392024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50402024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50412024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
50422024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
50432024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50442024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
50452024-11-05T00:05:42.172ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-04 23:55:42.172197605 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50462024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50472024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50482024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
50492024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
50502024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50512024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50522024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
50532024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50542024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
50552024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
50562024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50572024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50582024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
50592024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50602024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
50612024-11-05T00:05:42.172ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50622024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50632024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
50642024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
50652024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
50662024-11-05T00:05:42.172ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50672024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
50682024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50692024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50702024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50712024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
50722024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50732024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
50742024-11-05T00:05:42.172ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970
50752024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
50762024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.27\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970"}
50772024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50782024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
50792024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
50802024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
50812024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50822024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
50832024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
50842024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50852024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50862024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50872024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50882024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50892024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50902024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50912024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50922024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50932024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50942024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50952024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50962024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50972024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50982024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50992024-11-05T00:05:42.172ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f4c9dd5-dad6-4fc2-ba58-b064adbea295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2985, tv_nsec: 758935095 } })
51002024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51012024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51022024-11-05T00:05:42.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51032024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51042024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51052024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
51062024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
51072024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.14\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
51082024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
51092024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
51102024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
51112024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.94\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51122024-11-05T00:05:42.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("08f058bf-bffa-4561-8799-2d5d32641d33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e5a3f00-3f5b-4cac-8aa4-99515a0afee2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2985, tv_nsec: 759060407 } })
51132024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
51142024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
51152024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.26\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
51162024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
51172024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.36\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51182024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
51192024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
51202024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 961.22\u{b5}s iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
51212024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
51222024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51232024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
51242024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.059892ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
51252024-11-05T00:05:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51262024-11-05T00:05:42.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51272024-11-05T00:05:42.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51282024-11-05T00:05:42.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51292024-11-05T00:05:42.175ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.612585ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51302024-11-05T00:05:42.176ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-04 23:55:42.172197605 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
51312024-11-05T00:05:42.176ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.624235ms iteration = 12 status = {"expiration":"2024-11-04T23:55:42.172197605Z","pruned":[]}
51322024-11-05T00:05:42.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51332024-11-05T00:05:42.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51342024-11-05T00:05:42.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51352024-11-05T00:05:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51362024-11-05T00:05:42.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51372024-11-05T00:05:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51382024-11-05T00:05:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51392024-11-05T00:05:42.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51402024-11-05T00:05:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51412024-11-05T00:05:42.179ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2985, tv_nsec: 765841896 } })
51422024-11-05T00:05:42.180ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
51432024-11-05T00:05:42.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51442024-11-05T00:05:42.184ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2985, tv_nsec: 769570423 } })
51452024-11-05T00:05:42.184ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51462024-11-05T00:05:42.184ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
51472024-11-05T00:05:42.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51482024-11-05T00:05:42.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51492024-11-05T00:05:42.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51502024-11-05T00:05:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51512024-11-05T00:05:42.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51522024-11-05T00:05:42.187ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51532024-11-05T00:05:42.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51542024-11-05T00:05:42.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51552024-11-05T00:05:42.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51562024-11-05T00:05:42.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51572024-11-05T00:05:42.188ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51582024-11-05T00:05:42.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51592024-11-05T00:05:42.188ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51602024-11-05T00:05:42.189ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51612024-11-05T00:05:42.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51622024-11-05T00:05:42.190ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51632024-11-05T00:05:42.190ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51642024-11-05T00:05:42.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51652024-11-05T00:05:42.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51662024-11-05T00:05:42.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51672024-11-05T00:05:42.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51682024-11-05T00:05:42.190ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51692024-11-05T00:05:42.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51702024-11-05T00:05:42.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51712024-11-05T00:05:42.192ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51722024-11-05T00:05:42.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51732024-11-05T00:05:42.193ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51742024-11-05T00:05:42.193ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51752024-11-05T00:05:42.193ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.338748ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51762024-11-05T00:05:42.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51772024-11-05T00:05:42.195ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.031232ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
51782024-11-05T00:05:42.198ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51792024-11-05T00:05:42.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51802024-11-05T00:05:42.200ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2985, tv_nsec: 785997240 } })
51812024-11-05T00:05:42.200ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
51822024-11-05T00:05:42.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51832024-11-05T00:05:42.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51842024-11-05T00:05:42.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51852024-11-05T00:05:42.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51862024-11-05T00:05:42.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51872024-11-05T00:05:42.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51882024-11-05T00:05:42.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51892024-11-05T00:05:42.206ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51902024-11-05T00:05:42.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51912024-11-05T00:05:42.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51922024-11-05T00:05:42.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.551811ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51932024-11-05T00:05:42.211ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51942024-11-05T00:05:42.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51952024-11-05T00:05:42.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51962024-11-05T00:05:42.217ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51972024-11-05T00:05:42.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51982024-11-05T00:05:42.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51992024-11-05T00:05:42.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52002024-11-05T00:05:42.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52012024-11-05T00:05:42.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
52022024-11-05T00:05:42.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52032024-11-05T00:05:42.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52042024-11-05T00:05:42.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52052024-11-05T00:05:42.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52062024-11-05T00:05:42.245ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
52072024-11-05T00:05:42.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.666662ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
52082024-11-05T00:05:42.264ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52092024-11-05T00:05:42.264ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52102024-11-05T00:05:42.264ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52112024-11-05T00:05:42.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52122024-11-05T00:05:42.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52132024-11-05T00:05:42.265ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
52142024-11-05T00:05:42.265ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
52152024-11-05T00:05:42.265ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 92.688492ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
52162024-11-05T00:05:42.265ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52172024-11-05T00:05:42.265ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52182024-11-05T00:05:42.265ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52192024-11-05T00:05:42.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52202024-11-05T00:05:42.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52212024-11-05T00:05:42.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52222024-11-05T00:05:42.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52232024-11-05T00:05:42.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52242024-11-05T00:05:42.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52252024-11-05T00:05:42.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52262024-11-05T00:05:42.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52272024-11-05T00:05:42.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52282024-11-05T00:05:42.272ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52292024-11-05T00:05:42.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52302024-11-05T00:05:42.275ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
52312024-11-05T00:05:42.275ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52322024-11-05T00:05:42.275ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52332024-11-05T00:05:42.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52342024-11-05T00:05:42.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52352024-11-05T00:05:42.276ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 104.349531ms iteration = 26 status = {"physical_disks_added":0}
52362024-11-05T00:05:42.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
52372024-11-05T00:05:42.277ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52382024-11-05T00:05:42.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52392024-11-05T00:05:42.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
52402024-11-05T00:05:42.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52412024-11-05T00:05:42.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52422024-11-05T00:05:42.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52432024-11-05T00:05:42.283ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52442024-11-05T00:05:42.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52452024-11-05T00:05:42.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52462024-11-05T00:05:42.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52472024-11-05T00:05:42.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52482024-11-05T00:05:42.285ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52492024-11-05T00:05:42.285ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.433638ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52502024-11-05T00:05:42.286ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 113.99041ms iteration = 23 status = 0
52512024-11-05T00:05:42.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.753447ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52522024-11-05T00:05:42.293ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52532024-11-05T00:05:42.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52542024-11-05T00:05:42.299ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52552024-11-05T00:05:42.309ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52562024-11-05T00:05:42.309ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52572024-11-05T00:05:42.309ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.41282ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52582024-11-05T00:05:42.311ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
52592024-11-05T00:05:42.311ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
52602024-11-05T00:05:42.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52612024-11-05T00:05:42.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52622024-11-05T00:05:42.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52632024-11-05T00:05:42.315ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
52642024-11-05T00:05:42.315ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 0 version = 2
52652024-11-05T00:05:42.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52662024-11-05T00:05:42.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52672024-11-05T00:05:42.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52682024-11-05T00:05:42.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52692024-11-05T00:05:42.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52702024-11-05T00:05:42.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52712024-11-05T00:05:42.318ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52722024-11-05T00:05:42.319ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
52732024-11-05T00:05:42.319ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
52742024-11-05T00:05:42.319ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-04 23:54:43.769339 UTC dns_group = internal generation = 1
52752024-11-05T00:05:42.319ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 147.329213ms iteration = 12 status = {"generation":1}
52762024-11-05T00:05:42.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52772024-11-05T00:05:42.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52782024-11-05T00:05:42.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52792024-11-05T00:05:42.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52802024-11-05T00:05:42.320ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52812024-11-05T00:05:42.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52822024-11-05T00:05:42.322ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 1 version = 2
52832024-11-05T00:05:42.322ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
52842024-11-05T00:05:42.322ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-04 23:54:45.073528 UTC dns_group = external generation = 2
52852024-11-05T00:05:42.322ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 150.028709ms iteration = 12 status = {"generation":2}
52862024-11-05T00:05:42.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52872024-11-05T00:05:42.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52882024-11-05T00:05:42.340ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52892024-11-05T00:05:42.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52902024-11-05T00:05:42.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52912024-11-05T00:05:42.343ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52922024-11-05T00:05:42.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52932024-11-05T00:05:42.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52942024-11-05T00:05:42.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52952024-11-05T00:05:42.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52962024-11-05T00:05:42.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52972024-11-05T00:05:42.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52982024-11-05T00:05:42.359ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
52992024-11-05T00:05:42.359ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
53002024-11-05T00:05:42.359ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53012024-11-05T00:05:42.359ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 187.260374ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
53022024-11-05T00:05:42.359ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2e361de-9c41-4b4c-86c6-18007e27e781", "content-length": "26", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53032024-11-05T00:05:42.359ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53042024-11-05T00:05:42.361ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53052024-11-05T00:05:42.371ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-04T23:54:39.943212Z, time_modified: 2024-11-04T23:54:39.943212Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }) }
53062024-11-05T00:05:42.372ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 199.79706ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]}},"default_endpoint":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
53072024-11-05T00:05:42.380ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
53082024-11-05T00:05:42.380ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53092024-11-05T00:05:42.381ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cb894de-ee36-4e41-8fdf-60b3e2f9edd6", "content-length": "26", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53102024-11-05T00:05:42.381ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53112024-11-05T00:05:42.383ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53122024-11-05T00:05:42.388ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53132024-11-05T00:05:42.510ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
53142024-11-05T00:05:42.511ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "423701d8-c457-435e-a490-d11ad4317b28", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53152024-11-05T00:05:42.511ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53162024-11-05T00:05:42.520ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "79c2188c-d75e-4de0-a18a-5a41b58ab367", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53172024-11-05T00:05:42.520ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53182024-11-05T00:05:42.522ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53192024-11-05T00:05:42.522ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 349.913233ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
53202024-11-05T00:05:42.535ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53212024-11-05T00:05:42.535ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53222024-11-05T00:05:42.536ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3ac25b7-965c-4df1-b951-45bf8b3fbe6a", "content-length": "372", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53232024-11-05T00:05:42.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53242024-11-05T00:05:42.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53252024-11-05T00:05:42.553ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
53262024-11-05T00:05:42.553ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53272024-11-05T00:05:42.554ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3c75335-7d14-4b99-a1bd-cff4dac98429", "content-length": "26", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53282024-11-05T00:05:42.554ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53292024-11-05T00:05:42.557ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
53302024-11-05T00:05:42.558ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53312024-11-05T00:05:42.559ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc730a25-85eb-4fcd-b20c-1c845131061e", "content-length": "691", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53322024-11-05T00:05:42.559ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
53332024-11-05T00:05:42.559ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
53342024-11-05T00:05:42.559ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
53352024-11-05T00:05:42.562ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.906873ms iteration = 23 status = {}
53362024-11-05T00:05:42.570ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53372024-11-05T00:05:42.570ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "399f5e3a-f341-4cfb-894b-1a3c84a0568b", "content-length": "1", "date": "Tue, 05 Nov 2024 00:05:41 GMT"} })
53382024-11-05T00:05:42.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53392024-11-05T00:05:42.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53402024-11-05T00:05:42.577ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 405.186377ms iteration = 23 status = null
53412024-11-05T00:05:42.600ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
53422024-11-05T00:05:42.600ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53432024-11-05T00:05:42.601ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0dc8aef1-0532-4e94-ac33-a51f78d5cc40", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53442024-11-05T00:05:42.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53452024-11-05T00:05:42.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53462024-11-05T00:05:42.601ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 429.436266ms iteration = 23 status = {}
53472024-11-05T00:05:42.603ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53482024-11-05T00:05:42.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53492024-11-05T00:05:42.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53502024-11-05T00:05:42.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53512024-11-05T00:05:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53522024-11-05T00:05:42.611ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53532024-11-05T00:05:42.611ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53542024-11-05T00:05:42.611ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4c5875a7-f36e-4da8-afae-3963275966b7", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53552024-11-05T00:05:42.613ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 440.719447ms iteration = 23 status = {}
53562024-11-05T00:05:42.663ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
53572024-11-05T00:05:42.663ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "71f4644d-ffab-4a17-989b-33e6f58d06ed", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53582024-11-05T00:05:42.664ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53592024-11-05T00:05:42.664ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "79cfc1c9-58c5-4a54-b1c3-9a27b381c8c3", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53602024-11-05T00:05:42.664ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53612024-11-05T00:05:42.666ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dac73c94-1617-4d74-b479-fabda829729f", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53622024-11-05T00:05:42.666ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53632024-11-05T00:05:42.668ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53642024-11-05T00:05:42.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 496.474131ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53652024-11-05T00:05:42.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53662024-11-05T00:05:42.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53672024-11-05T00:05:42.727ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
53682024-11-05T00:05:42.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53692024-11-05T00:05:42.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53702024-11-05T00:05:42.736ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53712024-11-05T00:05:42.736ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecefec97-8059-447d-8804-fdef80654e4d", "content-length": "134", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53722024-11-05T00:05:42.736ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53732024-11-05T00:05:42.736ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
53742024-11-05T00:05:42.736ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53752024-11-05T00:05:42.736ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53762024-11-05T00:05:42.736ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53772024-11-05T00:05:42.736ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53782024-11-05T00:05:42.736ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53792024-11-05T00:05:42.736ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53802024-11-05T00:05:42.737ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53812024-11-05T00:05:42.737ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53822024-11-05T00:05:42.737ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
53832024-11-05T00:05:42.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53842024-11-05T00:05:42.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53852024-11-05T00:05:42.739ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53862024-11-05T00:05:42.739ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bad1c844-1558-4b6a-aacd-df32b862e594", "content-length": "2", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53872024-11-05T00:05:42.739ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53882024-11-05T00:05:42.739ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fd23768-875d-4804-8d96-dfada0e1e774", "content-length": "52", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53892024-11-05T00:05:42.739ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
53902024-11-05T00:05:42.739ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53912024-11-05T00:05:42.838ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2c22941e-ada5-4cf2-9f47-a235cc4db022", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53922024-11-05T00:05:42.838ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
53932024-11-05T00:05:42.838ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53942024-11-05T00:05:42.838ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bd195b3-aa80-44a3-9ecc-26e56fcee7bd", "content-length": "682", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
53952024-11-05T00:05:42.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53962024-11-05T00:05:42.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53972024-11-05T00:05:42.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53982024-11-05T00:05:42.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53992024-11-05T00:05:42.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54002024-11-05T00:05:42.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54012024-11-05T00:05:42.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54022024-11-05T00:05:42.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54032024-11-05T00:05:42.855ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 683.380159ms iteration = 23 status = {}
54042024-11-05T00:05:42.888ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
54052024-11-05T00:05:42.888ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
54062024-11-05T00:05:42.922ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
54072024-11-05T00:05:42.922ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:50354
54082024-11-05T00:05:42.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50354 req_id = 1b26a981-6899-4d64-be46-f27f6aea54ca roles = RoleSet { roles: {} } uri = /metrics/producers
54092024-11-05T00:05:42.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50354 req_id = 1b26a981-6899-4d64-be46-f27f6aea54ca resource = Database result = Ok(()) uri = /metrics/producers
54102024-11-05T00:05:42.958ZINFOnexus: assigned collector to new producer collector_id = 936f0bc7-d5c8-4edc-b21c-cc06e01960a5 file = nexus/src/app/oximeter.rs:76 producer_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
54112024-11-05T00:05:42.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35853 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50354 req_id = 1b26a981-6899-4d64-be46-f27f6aea54ca response_code = 201 uri = /metrics/producers
54122024-11-05T00:05:42.958ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "1b26a981-6899-4d64-be46-f27f6aea54ca", "content-length": "41", "date": "Tue, 05 Nov 2024 00:05:42 GMT"} })
54132024-11-05T00:05:42.960ZDEBGnexus (producer-registration-task): registered with nexus successfully
54142024-11-05T00:05:42.960ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
54152024-11-05T00:05:42.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8e76a8b7-973d-4e00-85e6-b0d50c1688e4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54162024-11-05T00:05:42.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8e76a8b7-973d-4e00-85e6-b0d50c1688e4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54172024-11-05T00:05:42.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8e76a8b7-973d-4e00-85e6-b0d50c1688e4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54182024-11-05T00:05:44.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 01a8181c-05b2-4627-9c25-3496f1862be9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54192024-11-05T00:05:44.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 01a8181c-05b2-4627-9c25-3496f1862be9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54202024-11-05T00:05:44.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 01a8181c-05b2-4627-9c25-3496f1862be9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54212024-11-05T00:05:45.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6ac01dfb-98d3-4154-a445-90dede1021ea roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54222024-11-05T00:05:45.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6ac01dfb-98d3-4154-a445-90dede1021ea resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54232024-11-05T00:05:45.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6ac01dfb-98d3-4154-a445-90dede1021ea response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54242024-11-05T00:05:46.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 86066a35-f262-436b-920c-3e80693f957b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54252024-11-05T00:05:46.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 86066a35-f262-436b-920c-3e80693f957b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54262024-11-05T00:05:46.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 86066a35-f262-436b-920c-3e80693f957b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54272024-11-05T00:05:47.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 549fc0e7-5f2d-4084-a819-cb9334d50d02 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54282024-11-05T00:05:47.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 549fc0e7-5f2d-4084-a819-cb9334d50d02 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54292024-11-05T00:05:47.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 549fc0e7-5f2d-4084-a819-cb9334d50d02 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54302024-11-05T00:05:48.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4ce180da-9bdb-4927-acdf-b0d803a4f0eb roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54312024-11-05T00:05:48.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4ce180da-9bdb-4927-acdf-b0d803a4f0eb resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54322024-11-05T00:05:48.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4ce180da-9bdb-4927-acdf-b0d803a4f0eb response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54332024-11-05T00:05:49.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 240bab52-9620-4e40-a439-08eaf51c3567 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54342024-11-05T00:05:49.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 240bab52-9620-4e40-a439-08eaf51c3567 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54352024-11-05T00:05:49.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 240bab52-9620-4e40-a439-08eaf51c3567 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54362024-11-05T00:05:50.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fa150546-5d4f-467a-a9bf-636dd0d43c58 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54372024-11-05T00:05:50.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fa150546-5d4f-467a-a9bf-636dd0d43c58 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54382024-11-05T00:05:50.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fa150546-5d4f-467a-a9bf-636dd0d43c58 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54392024-11-05T00:05:51.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 47cc1140-5950-4ef6-ab04-5d616bd211df roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54402024-11-05T00:05:51.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 47cc1140-5950-4ef6-ab04-5d616bd211df resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54412024-11-05T00:05:51.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 47cc1140-5950-4ef6-ab04-5d616bd211df response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54422024-11-05T00:05:51.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 640 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = da970fa5-61a1-4ebe-b580-2bde7002725b response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
54432024-11-05T00:05:52.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
54442024-11-05T00:05:52.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
54452024-11-05T00:05:52.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54462024-11-05T00:05:52.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54472024-11-05T00:05:52.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54482024-11-05T00:05:52.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54492024-11-05T00:05:52.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54502024-11-05T00:05:52.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54512024-11-05T00:05:52.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54522024-11-05T00:05:52.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.992542ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54532024-11-05T00:05:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54542024-11-05T00:05:52.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54552024-11-05T00:05:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54562024-11-05T00:05:52.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54572024-11-05T00:05:52.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54582024-11-05T00:05:52.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54592024-11-05T00:05:52.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
54602024-11-05T00:05:52.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54612024-11-05T00:05:52.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54622024-11-05T00:05:52.192ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
54632024-11-05T00:05:52.193ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.988471ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
54642024-11-05T00:05:52.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac918e57-d2c0-4a23-9aa8-c79cc9fc8b27 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54652024-11-05T00:05:52.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac918e57-d2c0-4a23-9aa8-c79cc9fc8b27 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54662024-11-05T00:05:52.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac918e57-d2c0-4a23-9aa8-c79cc9fc8b27 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54672024-11-05T00:05:53.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a4a68b88-560c-4f8e-b65b-05de056717cf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54682024-11-05T00:05:53.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a4a68b88-560c-4f8e-b65b-05de056717cf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54692024-11-05T00:05:53.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a4a68b88-560c-4f8e-b65b-05de056717cf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54702024-11-05T00:05:54.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cf11978e-3a12-4d6e-a8bd-d903b4ffe785 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54712024-11-05T00:05:54.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cf11978e-3a12-4d6e-a8bd-d903b4ffe785 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54722024-11-05T00:05:54.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2704 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cf11978e-3a12-4d6e-a8bd-d903b4ffe785 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54732024-11-05T00:05:55.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b5cdf6ab-6ad5-447e-926a-f64520b7afe2 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54742024-11-05T00:05:55.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b5cdf6ab-6ad5-447e-926a-f64520b7afe2 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54752024-11-05T00:05:55.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b5cdf6ab-6ad5-447e-926a-f64520b7afe2 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54762024-11-05T00:05:56.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e1660b56-052e-4cc8-a39d-f34fb687e37a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54772024-11-05T00:05:56.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e1660b56-052e-4cc8-a39d-f34fb687e37a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54782024-11-05T00:05:56.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e1660b56-052e-4cc8-a39d-f34fb687e37a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54792024-11-05T00:05:57.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2c44701-059f-4a01-b921-aea0a7c6f96b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54802024-11-05T00:05:57.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2c44701-059f-4a01-b921-aea0a7c6f96b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54812024-11-05T00:05:57.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2c44701-059f-4a01-b921-aea0a7c6f96b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54822024-11-05T00:05:58.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0a6875fb-15a3-4eee-890d-536036b86a82 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54832024-11-05T00:05:58.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0a6875fb-15a3-4eee-890d-536036b86a82 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54842024-11-05T00:05:58.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0a6875fb-15a3-4eee-890d-536036b86a82 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54852024-11-05T00:05:59.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bc58eee4-c9c2-4877-83c6-1023afe247f1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54862024-11-05T00:05:59.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bc58eee4-c9c2-4877-83c6-1023afe247f1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54872024-11-05T00:05:59.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bc58eee4-c9c2-4877-83c6-1023afe247f1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54882024-11-05T00:06:00.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 735732a8-a962-45bf-95d9-1aeb58117be7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54892024-11-05T00:06:00.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 735732a8-a962-45bf-95d9-1aeb58117be7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54902024-11-05T00:06:00.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 735732a8-a962-45bf-95d9-1aeb58117be7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54912024-11-05T00:06:01.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 973f34c3-28a6-4c8f-a868-044d30b65a0e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54922024-11-05T00:06:01.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 973f34c3-28a6-4c8f-a868-044d30b65a0e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54932024-11-05T00:06:01.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 973f34c3-28a6-4c8f-a868-044d30b65a0e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
54942024-11-05T00:06:02.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
54952024-11-05T00:06:02.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
54962024-11-05T00:06:02.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54972024-11-05T00:06:02.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54982024-11-05T00:06:02.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54992024-11-05T00:06:02.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55002024-11-05T00:06:02.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55012024-11-05T00:06:02.176ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55022024-11-05T00:06:02.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55032024-11-05T00:06:02.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55042024-11-05T00:06:02.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55052024-11-05T00:06:02.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55062024-11-05T00:06:02.180ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 8.230869ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55072024-11-05T00:06:02.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55082024-11-05T00:06:02.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55092024-11-05T00:06:02.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55102024-11-05T00:06:02.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
55112024-11-05T00:06:02.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55122024-11-05T00:06:02.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55132024-11-05T00:06:02.204ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
55142024-11-05T00:06:02.204ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.61702ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
55152024-11-05T00:06:02.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c3521aaf-d43e-4683-ae98-47e31ba69459 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55162024-11-05T00:06:02.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c3521aaf-d43e-4683-ae98-47e31ba69459 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55172024-11-05T00:06:02.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c3521aaf-d43e-4683-ae98-47e31ba69459 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55182024-11-05T00:06:03.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 25522873-1df3-4944-a791-877d421032e4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55192024-11-05T00:06:03.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 25522873-1df3-4944-a791-877d421032e4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55202024-11-05T00:06:03.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 25522873-1df3-4944-a791-877d421032e4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55212024-11-05T00:06:04.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 38e92636-e81b-462e-ad29-e0e064c0fd45 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55222024-11-05T00:06:04.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 38e92636-e81b-462e-ad29-e0e064c0fd45 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55232024-11-05T00:06:04.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 38e92636-e81b-462e-ad29-e0e064c0fd45 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55242024-11-05T00:06:05.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 73023ced-f762-49fb-bae6-74153716241c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55252024-11-05T00:06:05.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 73023ced-f762-49fb-bae6-74153716241c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55262024-11-05T00:06:05.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 73023ced-f762-49fb-bae6-74153716241c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55272024-11-05T00:06:06.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 235071ac-0798-451a-b173-834006d3bb9e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55282024-11-05T00:06:06.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 235071ac-0798-451a-b173-834006d3bb9e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55292024-11-05T00:06:06.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 235071ac-0798-451a-b173-834006d3bb9e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55302024-11-05T00:06:06.882ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 496 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 3b3f61fd-9088-43a6-a971-888c09f579ee response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
55312024-11-05T00:06:07.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1c872da4-f79d-4692-afb5-9a376cc7dd82 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55322024-11-05T00:06:07.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1c872da4-f79d-4692-afb5-9a376cc7dd82 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55332024-11-05T00:06:07.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1c872da4-f79d-4692-afb5-9a376cc7dd82 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55342024-11-05T00:06:08.057ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dae68a73-fee4-4624-be01-90976428e742 remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 503d5fd9-c861-4347-b48e-be7c3153f16e uri = /vmms/dae68a73-fee4-4624-be01-90976428e742 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-05T00:06:08.035911731Z }
55352024-11-05T00:06:08.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 503d5fd9-c861-4347-b48e-be7c3153f16e roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
55362024-11-05T00:06:08.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 503d5fd9-c861-4347-b48e-be7c3153f16e resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
55372024-11-05T00:06:08.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42831 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 503d5fd9-c861-4347-b48e-be7c3153f16e response_code = 204 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
55382024-11-05T00:06:08.079ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dae68a73-fee4-4624-be01-90976428e742 remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 23f11f02-0236-4743-832b-b50a7c25b72b uri = /vmms/dae68a73-fee4-4624-be01-90976428e742 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-05T00:06:08.079373363Z }
55392024-11-05T00:06:08.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 23f11f02-0236-4743-832b-b50a7c25b72b roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
55402024-11-05T00:06:08.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 23f11f02-0236-4743-832b-b50a7c25b72b resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
55412024-11-05T00:06:08.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10339 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 23f11f02-0236-4743-832b-b50a7c25b72b response_code = 204 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
55422024-11-05T00:06:08.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d1c4a1e0-5eb2-4954-85a7-8d4c97f44477 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55432024-11-05T00:06:08.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d1c4a1e0-5eb2-4954-85a7-8d4c97f44477 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55442024-11-05T00:06:08.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d1c4a1e0-5eb2-4954-85a7-8d4c97f44477 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55452024-11-05T00:06:09.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1e7c7ef9-ba74-4618-af62-5da6e7fd4795 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55462024-11-05T00:06:09.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1e7c7ef9-ba74-4618-af62-5da6e7fd4795 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55472024-11-05T00:06:09.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1e7c7ef9-ba74-4618-af62-5da6e7fd4795 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55482024-11-05T00:06:10.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5bd18684-fce2-4404-9009-f2fd9507cd01 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55492024-11-05T00:06:10.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5bd18684-fce2-4404-9009-f2fd9507cd01 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55502024-11-05T00:06:10.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5bd18684-fce2-4404-9009-f2fd9507cd01 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55512024-11-05T00:06:11.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 996a53f8-c7b1-4d1a-89d2-75b469018f48 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55522024-11-05T00:06:11.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 996a53f8-c7b1-4d1a-89d2-75b469018f48 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55532024-11-05T00:06:11.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 996a53f8-c7b1-4d1a-89d2-75b469018f48 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
55542024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
55552024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55562024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
55572024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
55582024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55592024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55602024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55612024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
55622024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
55632024-11-05T00:06:12.173ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
55642024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55652024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
55662024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55672024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
55682024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.631\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
55692024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
55702024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
55712024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.41\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
55722024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
55732024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
55742024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55752024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.11\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55762024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
55772024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55782024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
55792024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.421\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55802024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55812024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
55822024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
55832024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55842024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
55852024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55862024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55872024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
55882024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55892024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55902024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55912024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55922024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55932024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55942024-11-05T00:06:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55952024-11-05T00:06:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55962024-11-05T00:06:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55972024-11-05T00:06:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55982024-11-05T00:06:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55992024-11-05T00:06:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56002024-11-05T00:06:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56012024-11-05T00:06:12.176ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56022024-11-05T00:06:12.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3015, tv_nsec: 762484977 } })
56032024-11-05T00:06:12.176ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56042024-11-05T00:06:12.176ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56052024-11-05T00:06:12.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56062024-11-05T00:06:12.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
56072024-11-05T00:06:12.177ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.677125ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56082024-11-05T00:06:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56092024-11-05T00:06:12.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56102024-11-05T00:06:12.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56112024-11-05T00:06:12.179ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56122024-11-05T00:06:12.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56132024-11-05T00:06:12.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56142024-11-05T00:06:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56152024-11-05T00:06:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56162024-11-05T00:06:12.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56172024-11-05T00:06:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56182024-11-05T00:06:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56192024-11-05T00:06:12.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56202024-11-05T00:06:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56212024-11-05T00:06:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56222024-11-05T00:06:12.181ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56232024-11-05T00:06:12.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56242024-11-05T00:06:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56252024-11-05T00:06:12.182ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56262024-11-05T00:06:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56272024-11-05T00:06:12.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56282024-11-05T00:06:12.182ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3015, tv_nsec: 768491860 } })
56292024-11-05T00:06:12.183ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
56302024-11-05T00:06:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56312024-11-05T00:06:12.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56322024-11-05T00:06:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56332024-11-05T00:06:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56342024-11-05T00:06:12.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56352024-11-05T00:06:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56362024-11-05T00:06:12.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56372024-11-05T00:06:12.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56382024-11-05T00:06:12.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56392024-11-05T00:06:12.187ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56402024-11-05T00:06:12.187ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56412024-11-05T00:06:12.187ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56422024-11-05T00:06:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56432024-11-05T00:06:12.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56442024-11-05T00:06:12.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56452024-11-05T00:06:12.187ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56462024-11-05T00:06:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56472024-11-05T00:06:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56482024-11-05T00:06:12.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56492024-11-05T00:06:12.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56502024-11-05T00:06:12.190ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3015, tv_nsec: 776613427 } })
56512024-11-05T00:06:12.191ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
56522024-11-05T00:06:12.191ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56532024-11-05T00:06:12.191ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56542024-11-05T00:06:12.191ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56552024-11-05T00:06:12.191ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 18.399797ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56562024-11-05T00:06:12.193ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56572024-11-05T00:06:12.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56582024-11-05T00:06:12.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56592024-11-05T00:06:12.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56602024-11-05T00:06:12.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56612024-11-05T00:06:12.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56622024-11-05T00:06:12.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56632024-11-05T00:06:12.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56642024-11-05T00:06:12.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56652024-11-05T00:06:12.222ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.947155ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56662024-11-05T00:06:12.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56672024-11-05T00:06:12.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
56682024-11-05T00:06:12.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56692024-11-05T00:06:12.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56702024-11-05T00:06:12.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56712024-11-05T00:06:12.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56722024-11-05T00:06:12.332ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
56732024-11-05T00:06:12.332ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56742024-11-05T00:06:12.332ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0181b3c-057a-4860-9765-f8157b006e10", "content-length": "26", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
56752024-11-05T00:06:12.332ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56762024-11-05T00:06:12.334ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
56772024-11-05T00:06:12.353ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
56782024-11-05T00:06:12.353ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56792024-11-05T00:06:12.353ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d03e063-f396-4b9b-b840-16697fefa5d3", "content-length": "585", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
56802024-11-05T00:06:12.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56812024-11-05T00:06:12.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56822024-11-05T00:06:12.457ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
56832024-11-05T00:06:12.458ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56842024-11-05T00:06:12.458ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1636cfb5-ccbd-4b3f-8c45-7cbdd0218e99", "content-length": "26", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
56852024-11-05T00:06:12.458ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56862024-11-05T00:06:12.460ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56872024-11-05T00:06:12.531ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
56882024-11-05T00:06:12.531ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56892024-11-05T00:06:12.531ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be9bb6a8-d404-435e-b57f-dee3d19a8f69", "content-length": "26", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
56902024-11-05T00:06:12.531ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56912024-11-05T00:06:12.533ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56922024-11-05T00:06:12.538ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/dae68a73-fee4-4624-be01-90976428e742/state
56932024-11-05T00:06:12.539ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/dae68a73-fee4-4624-be01-90976428e742/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "955017e3-c352-401d-9aed-f7377f8b7c91", "content-length": "130", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
56942024-11-05T00:06:12.542ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = b39559fe-2123-48a9-99eb-12895a3c669f sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-05T00:06:08.079373363Z }, migration_in: None, migration_out: None } vmm_id = dae68a73-fee4-4624-be01-90976428e742
56952024-11-05T00:06:12.542ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dae68a73-fee4-4624-be01-90976428e742 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 vmm_id = dae68a73-fee4-4624-be01-90976428e742 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-05T00:06:08.079373363Z }
56962024-11-05T00:06:12.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = b39559fe-2123-48a9-99eb-12895a3c669f roles = RoleSet { roles: {} } sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 vmm_id = dae68a73-fee4-4624-be01-90976428e742
56972024-11-05T00:06:12.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = b39559fe-2123-48a9-99eb-12895a3c669f resource = Database result = Ok(()) sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 vmm_id = dae68a73-fee4-4624-be01-90976428e742
56982024-11-05T00:06:12.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56992024-11-05T00:06:12.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57002024-11-05T00:06:12.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
57012024-11-05T00:06:12.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 380.633933ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
57022024-11-05T00:06:12.563ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {2e02a288-ac3d-4f8f-b721-40fdb59668c9: {10.151.1.175: {44f5b01c-06b5-4c83-8887-1732706cbf31}, 10.151.1.176: {44f5b01c-06b5-4c83-8887-1732706cbf31}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
57032024-11-05T00:06:12.564ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57042024-11-05T00:06:12.564ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1ccc5625-f7ed-4c17-9a8e-2cf6b1f7c3e5", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
57052024-11-05T00:06:12.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57062024-11-05T00:06:12.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57072024-11-05T00:06:12.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57082024-11-05T00:06:12.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57092024-11-05T00:06:12.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57102024-11-05T00:06:12.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57112024-11-05T00:06:12.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57122024-11-05T00:06:12.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57132024-11-05T00:06:12.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57142024-11-05T00:06:12.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57152024-11-05T00:06:12.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57162024-11-05T00:06:12.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57172024-11-05T00:06:12.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57182024-11-05T00:06:12.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57192024-11-05T00:06:12.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57202024-11-05T00:06:12.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57212024-11-05T00:06:12.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
57222024-11-05T00:06:12.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57232024-11-05T00:06:12.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57242024-11-05T00:06:12.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57252024-11-05T00:06:12.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57262024-11-05T00:06:12.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57272024-11-05T00:06:12.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 407.544555ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57282024-11-05T00:06:12.581ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 408.036516ms iteration = 24 status = 0
57292024-11-05T00:06:12.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57302024-11-05T00:06:12.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57312024-11-05T00:06:12.584ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
57322024-11-05T00:06:12.585ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 412.333885ms iteration = 24 status = {}
57332024-11-05T00:06:12.586ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 413.241502ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
57342024-11-05T00:06:12.587ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57352024-11-05T00:06:12.587ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57362024-11-05T00:06:12.587ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57372024-11-05T00:06:12.587ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "af41aaf6-2462-4c9b-93da-f38acff6ba52", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
57382024-11-05T00:06:12.589ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 416.01257ms iteration = 24 status = {}
57392024-11-05T00:06:12.610ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57402024-11-05T00:06:12.610ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "56b22b5b-5361-4923-8072-df7d218a525e", "content-length": "1", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
57412024-11-05T00:06:12.612ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57422024-11-05T00:06:12.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57432024-11-05T00:06:12.615ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 442.077534ms iteration = 24 status = null
57442024-11-05T00:06:12.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57452024-11-05T00:06:12.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57462024-11-05T00:06:12.623ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
57472024-11-05T00:06:12.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57482024-11-05T00:06:12.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57492024-11-05T00:06:12.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57502024-11-05T00:06:12.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9612153-9f53-4fa3-a487-15736a929bc7", "content-length": "134", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
57512024-11-05T00:06:12.633ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57522024-11-05T00:06:12.633ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
57532024-11-05T00:06:12.633ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57542024-11-05T00:06:12.633ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57552024-11-05T00:06:12.633ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57562024-11-05T00:06:12.633ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57572024-11-05T00:06:12.633ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57582024-11-05T00:06:12.633ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57592024-11-05T00:06:12.633ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57602024-11-05T00:06:12.634ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57612024-11-05T00:06:12.634ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
57622024-11-05T00:06:12.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57632024-11-05T00:06:12.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57642024-11-05T00:06:12.636ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57652024-11-05T00:06:12.636ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4d25485-c44b-43b9-925d-2907bbf9ba43", "content-length": "2", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
57662024-11-05T00:06:12.636ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57672024-11-05T00:06:12.636ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "14511a54-50a7-4d38-8704-4b29204a0d30", "content-length": "52", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
57682024-11-05T00:06:12.636ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
57692024-11-05T00:06:12.636ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57702024-11-05T00:06:12.652ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 479.445892ms iteration = 27 status = {"physical_disks_added":0}
57712024-11-05T00:06:12.677ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57722024-11-05T00:06:12.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 82795cbe-b960-4217-bdff-3c27faf30498 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
57732024-11-05T00:06:12.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 82795cbe-b960-4217-bdff-3c27faf30498 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
57742024-11-05T00:06:12.745ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9dc9860-3b76-4a93-add4-9bfe6afba7de", "content-length": "811", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
57752024-11-05T00:06:12.745ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(15142702) }} sled = buskin
57762024-11-05T00:06:12.745ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57772024-11-05T00:06:12.745ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57782024-11-05T00:06:12.747ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 574.221738ms iteration = 24 status = {}
57792024-11-05T00:06:12.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 82795cbe-b960-4217-bdff-3c27faf30498 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
57802024-11-05T00:06:12.880ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b4e1d7ac-4f13-4960-90ad-388ffec613b2", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
57812024-11-05T00:06:12.880ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
57822024-11-05T00:06:12.880ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57832024-11-05T00:06:12.884ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "488ba478-4c54-44bd-97da-751ab62162b0", "content-length": "682", "date": "Tue, 05 Nov 2024 00:06:12 GMT"} })
57842024-11-05T00:06:12.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57852024-11-05T00:06:12.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57862024-11-05T00:06:12.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57872024-11-05T00:06:12.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57882024-11-05T00:06:12.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57892024-11-05T00:06:12.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57902024-11-05T00:06:12.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57912024-11-05T00:06:12.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57922024-11-05T00:06:12.902ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 729.053075ms iteration = 24 status = {}
57932024-11-05T00:06:13.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 10fc1887-c234-40ce-96db-443e98f3ca02 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
57942024-11-05T00:06:13.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 10fc1887-c234-40ce-96db-443e98f3ca02 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
57952024-11-05T00:06:13.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 10fc1887-c234-40ce-96db-443e98f3ca02 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
57962024-11-05T00:06:14.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 44707ed1-8148-40f8-ae87-40bf15ca74bd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
57972024-11-05T00:06:14.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 44707ed1-8148-40f8-ae87-40bf15ca74bd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
57982024-11-05T00:06:14.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 44707ed1-8148-40f8-ae87-40bf15ca74bd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
57992024-11-05T00:06:15.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = da2a8257-225e-4320-94d1-18c74aeca50b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58002024-11-05T00:06:15.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = da2a8257-225e-4320-94d1-18c74aeca50b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58012024-11-05T00:06:15.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = da2a8257-225e-4320-94d1-18c74aeca50b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58022024-11-05T00:06:16.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 35a35851-ba73-4574-81ca-0a532ac7cf2f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58032024-11-05T00:06:16.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 35a35851-ba73-4574-81ca-0a532ac7cf2f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58042024-11-05T00:06:16.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 35a35851-ba73-4574-81ca-0a532ac7cf2f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58052024-11-05T00:06:17.750ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dae68a73-fee4-4624-be01-90976428e742 remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c7753405-070c-494a-819a-664200dd1493 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-05T00:06:17.749877767Z }
58062024-11-05T00:06:17.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c7753405-070c-494a-819a-664200dd1493 roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58072024-11-05T00:06:17.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c7753405-070c-494a-819a-664200dd1493 resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58082024-11-05T00:06:17.801ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:159 retry_after (ms) = 1 transaction = vmm_and_migration_update_runtime
58092024-11-05T00:06:17.809ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:115 transaction = vmm_and_migration_update_runtime
58102024-11-05T00:06:17.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59778 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c7753405-070c-494a-819a-664200dd1493 response_code = 204 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58112024-11-05T00:06:17.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 33d0f605-ff7d-4e44-bbb0-e5d2f03dbeb3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58122024-11-05T00:06:17.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 33d0f605-ff7d-4e44-bbb0-e5d2f03dbeb3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58132024-11-05T00:06:17.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 33d0f605-ff7d-4e44-bbb0-e5d2f03dbeb3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58142024-11-05T00:06:18.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3a3c2919-e518-40c7-b189-c792878cf92e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58152024-11-05T00:06:18.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3a3c2919-e518-40c7-b189-c792878cf92e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58162024-11-05T00:06:18.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3a3c2919-e518-40c7-b189-c792878cf92e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58172024-11-05T00:06:19.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 78cb194d-69ae-4d48-a5a4-5d436aefbffb roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58182024-11-05T00:06:19.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 78cb194d-69ae-4d48-a5a4-5d436aefbffb resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58192024-11-05T00:06:19.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 78cb194d-69ae-4d48-a5a4-5d436aefbffb response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
58202024-11-05T00:06:20.349ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dae68a73-fee4-4624-be01-90976428e742 remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-05T00:06:20.349241897Z }
58212024-11-05T00:06:20.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58222024-11-05T00:06:20.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58232024-11-05T00:06:20.358ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = dae68a73-fee4-4624-be01-90976428e742 remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742 vmm_needs_update = true
58242024-11-05T00:06:20.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58252024-11-05T00:06:20.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58262024-11-05T00:06:20.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58272024-11-05T00:06:20.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58282024-11-05T00:06:20.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58292024-11-05T00:06:20.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58302024-11-05T00:06:20.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58312024-11-05T00:06:20.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58322024-11-05T00:06:20.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58332024-11-05T00:06:20.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58342024-11-05T00:06:20.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58352024-11-05T00:06:20.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58362024-11-05T00:06:20.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58372024-11-05T00:06:20.438ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, lookup_type: ById(73cac2e6-afc3-4b45-b597-79dfc81e8ecd) }, key: ab7fcc9b-dbba-4d54-9ee5-c52185228a24, lookup_type: ById(ab7fcc9b-dbba-4d54-9ee5-c52185228a24) }, key: b39559fe-2123-48a9-99eb-12895a3c669f, lookup_type: ById(b39559fe-2123-48a9-99eb-12895a3c669f) } result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58382024-11-05T00:06:20.444ZINFOnexus (dropshot_internal): starting update saga for b39559fe-2123-48a9-99eb-12895a3c669f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-05T00:06:20.349241897Z }
58392024-11-05T00:06:20.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95012 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 response_code = 204 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58402024-11-05T00:06:20.444ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dae68a73-fee4-4624-be01-90976428e742 remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bd349e2a-5893-42c6-8d0a-39f482881ab0 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-05T00:06:20.349241897Z }
58412024-11-05T00:06:20.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bd349e2a-5893-42c6-8d0a-39f482881ab0 roles = RoleSet { roles: {} } uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58422024-11-05T00:06:20.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bd349e2a-5893-42c6-8d0a-39f482881ab0 resource = Database result = Ok(()) uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58432024-11-05T00:06:20.449ZDEBGnexus (dropshot_internal): preparing instance-update saga for b39559fe-2123-48a9-99eb-12895a3c669f... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = b39559fe-2123-48a9-99eb-12895a3c669f local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 981e1cb4-5825-42c6-98c2-1bca4eb1daf9 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58442024-11-05T00:06:20.449ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update
58452024-11-05T00:06:20.456ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"b39559fe-2123-48a9-99eb-12895a3c669f","lookup_type":{"ById":"b39559fe-2123-48a9-99eb-12895a3c669f"},"parent":{"key":"ab7fcc9b-dbba-4d54-9ee5-c52185228a24","lookup_type":{"ById":"ab7fcc9b-dbba-4d54-9ee5-c52185228a24"},"parent":{"key":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","lookup_type":{"ById":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
58462024-11-05T00:06:20.456ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update
58472024-11-05T00:06:20.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33416 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bd349e2a-5893-42c6-8d0a-39f482881ab0 response_code = 204 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
58482024-11-05T00:06:20.498ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update
58492024-11-05T00:06:20.498ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
58502024-11-05T00:06:20.498ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
58512024-11-05T00:06:20.498ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
58522024-11-05T00:06:20.505ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
58532024-11-05T00:06:20.505ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
58542024-11-05T00:06:20.509ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
58552024-11-05T00:06:20.509ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
58562024-11-05T00:06:20.518ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
58572024-11-05T00:06:20.518ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("607bb6ed-8e3a-44cd-8351-c8ff10ae5b64")) node_id = 0 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
58582024-11-05T00:06:20.521ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
58592024-11-05T00:06:20.521ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
58602024-11-05T00:06:20.542ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update
58612024-11-05T00:06:20.547ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58622024-11-05T00:06:20.547ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58632024-11-05T00:06:20.552ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58642024-11-05T00:06:20.552ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58652024-11-05T00:06:20.554ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58662024-11-05T00:06:20.554ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58672024-11-05T00:06:20.556ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58682024-11-05T00:06:20.556ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58692024-11-05T00:06:20.557ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58702024-11-05T00:06:20.558ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58712024-11-05T00:06:20.592ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58722024-11-05T00:06:20.593ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58732024-11-05T00:06:20.594ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58742024-11-05T00:06:20.600ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, lookup_type: ById(73cac2e6-afc3-4b45-b597-79dfc81e8ecd) }, key: ab7fcc9b-dbba-4d54-9ee5-c52185228a24, lookup_type: ById(ab7fcc9b-dbba-4d54-9ee5-c52185228a24) }, key: b39559fe-2123-48a9-99eb-12895a3c669f, lookup_type: ById(b39559fe-2123-48a9-99eb-12895a3c669f) } result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58752024-11-05T00:06:20.600ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance updater_id = 607bb6ed-8e3a-44cd-8351-c8ff10ae5b64
58762024-11-05T00:06:20.600ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58772024-11-05T00:06:20.600ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58782024-11-05T00:06:20.611ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance updater_id = 607bb6ed-8e3a-44cd-8351-c8ff10ae5b64
58792024-11-05T00:06:20.611ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58802024-11-05T00:06:20.611ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance
58812024-11-05T00:06:20.616ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = b39559fe-2123-48a9-99eb-12895a3c669f locked_gen = Generation(Generation(2)) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = LockInstance updater_id = 607bb6ed-8e3a-44cd-8351-c8ff10ae5b64
58822024-11-05T00:06:20.616ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
58832024-11-05T00:06:20.616ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("607bb6ed-8e3a-44cd-8351-c8ff10ae5b64")}) node_id = 1 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
58842024-11-05T00:06:20.620ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
58852024-11-05T00:06:20.620ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
58862024-11-05T00:06:20.625ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
58872024-11-05T00:06:20.626ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
58882024-11-05T00:06:20.627ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
58892024-11-05T00:06:20.627ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
58902024-11-05T00:06:20.628ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
58912024-11-05T00:06:20.629ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
58922024-11-05T00:06:20.630ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
58932024-11-05T00:06:20.633ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, lookup_type: ById(73cac2e6-afc3-4b45-b597-79dfc81e8ecd) }, key: ab7fcc9b-dbba-4d54-9ee5-c52185228a24, lookup_type: ById(ab7fcc9b-dbba-4d54-9ee5-c52185228a24) }, key: b39559fe-2123-48a9-99eb-12895a3c669f, lookup_type: ById(b39559fe-2123-48a9-99eb-12895a3c669f) } result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
58942024-11-05T00:06:20.633ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
58952024-11-05T00:06:20.633ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
58962024-11-05T00:06:20.641ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: dae68a73-fee4-4624-be01-90976428e742, time_created: 2024-11-05T00:05:59.406125Z, time_deleted: None, instance_id: b39559fe-2123-48a9-99eb-12895a3c669f, sled_id: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-05T00:06:20.349241Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-05T00:05:57.289650Z, gen: Generation(Generation(3)), propolis_id: Some(dae68a73-fee4-4624-be01-90976428e742), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(dae68a73-fee4-4624-be01-90976428e742 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-05T00:06:20.641384744Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
58972024-11-05T00:06:20.644ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
58982024-11-05T00:06:20.644ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"b39559fe-2123-48a9-99eb-12895a3c669f","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"dae68a73-fee4-4624-be01-90976428e742"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"b39559fe-2123-48a9-99eb-12895a3c669f","lookup_type":{"ById":"b39559fe-2123-48a9-99eb-12895a3c669f"},"parent":{"key":"ab7fcc9b-dbba-4d54-9ee5-c52185228a24","lookup_type":{"ById":"ab7fcc9b-dbba-4d54-9ee5-c52185228a24"},"parent":{"key":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","lookup_type":{"ById":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"607bb6ed-8e3a-44cd-8351-c8ff10ae5b64"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"ab7fcc9b-dbba-4d54-9ee5-c52185228a24","ram_diff":1073741824},"destroy_active_vmm":"dae68a73-fee4-4624-be01-90976428e742","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-05T00:06:20.641384744Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
58992024-11-05T00:06:20.644ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59002024-11-05T00:06:20.650ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59012024-11-05T00:06:20.650ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59022024-11-05T00:06:20.650ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59032024-11-05T00:06:20.650ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59042024-11-05T00:06:20.653ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59052024-11-05T00:06:20.653ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59062024-11-05T00:06:20.656ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59072024-11-05T00:06:20.656ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59082024-11-05T00:06:20.659ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59092024-11-05T00:06:20.659ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d60373c7-8ee2-4dfc-a5f4-ef9a03e01a45")) node_id = 0 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59102024-11-05T00:06:20.664ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59112024-11-05T00:06:20.664ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59122024-11-05T00:06:20.675ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = b39559fe-2123-48a9-99eb-12895a3c669f parent_lock = UpdaterLock { updater_id: 607bb6ed-8e3a-44cd-8351-c8ff10ae5b64, locked_gen: Generation(Generation(2)) } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59132024-11-05T00:06:20.675ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = BecomeUpdater
59142024-11-05T00:06:20.675ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = BecomeUpdater
59152024-11-05T00:06:20.690ZDEBGnexus (SagaExecutor): inherited lock from 607bb6ed-8e3a-44cd-8351-c8ff10ae5b64 to d60373c7-8ee2-4dfc-a5f4-ef9a03e01a45 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = b39559fe-2123-48a9-99eb-12895a3c669f locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 607bb6ed-8e3a-44cd-8351-c8ff10ae5b64 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = BecomeUpdater updater_id = d60373c7-8ee2-4dfc-a5f4-ef9a03e01a45
59162024-11-05T00:06:20.690ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59172024-11-05T00:06:20.690ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59182024-11-05T00:06:20.690ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("d60373c7-8ee2-4dfc-a5f4-ef9a03e01a45")}) node_id = 1 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59192024-11-05T00:06:20.694ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59202024-11-05T00:06:20.694ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59212024-11-05T00:06:20.697ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59222024-11-05T00:06:20.697ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59232024-11-05T00:06:20.700ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59242024-11-05T00:06:20.700ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59252024-11-05T00:06:20.708ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59262024-11-05T00:06:20.710ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f
59272024-11-05T00:06:20.710ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = UpdateNetworkConfig
59282024-11-05T00:06:20.710ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = UpdateNetworkConfig
59292024-11-05T00:06:20.712ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = UpdateNetworkConfig
59302024-11-05T00:06:20.712ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = UpdateNetworkConfig
59312024-11-05T00:06:20.715ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
59322024-11-05T00:06:20.715ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = UpdateNetworkConfig
59332024-11-05T00:06:20.715ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = UpdateNetworkConfig
59342024-11-05T00:06:20.717ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
59352024-11-05T00:06:20.719ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
59362024-11-05T00:06:20.720ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
59372024-11-05T00:06:20.721ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
59382024-11-05T00:06:20.722ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
59392024-11-05T00:06:20.722ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
59402024-11-05T00:06:20.722ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
59412024-11-05T00:06:20.726ZDEBGnexus: notifying dendrite of updates instance_id = Some(b39559fe-2123-48a9-99eb-12895a3c669f (instance)) switch = switch0
59422024-11-05T00:06:20.727ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3024, tv_nsec: 312724167 } })
59432024-11-05T00:06:20.727ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
59442024-11-05T00:06:20.757ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
59452024-11-05T00:06:20.757ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59462024-11-05T00:06:20.757ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec6972e2-142d-4ac2-ae16-4b2c31a20190", "content-length": "26", "date": "Tue, 05 Nov 2024 00:06:20 GMT"} })
59472024-11-05T00:06:20.757ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59482024-11-05T00:06:20.758ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59492024-11-05T00:06:20.788ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
59502024-11-05T00:06:20.788ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "93f51bba-c8d8-4fab-8002-1ee3149b99d1", "content-length": "4", "date": "Tue, 05 Nov 2024 00:06:20 GMT"} })
59512024-11-05T00:06:20.790ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59522024-11-05T00:06:20.790ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59532024-11-05T00:06:20.793ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59542024-11-05T00:06:20.793ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59552024-11-05T00:06:20.797ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ReleaseVirtualProvisioning
59562024-11-05T00:06:20.797ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ReleaseVirtualProvisioning
59572024-11-05T00:06:20.813ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-05T00:06:20.802687Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, time_modified: Some(2024-11-05T00:06:20.802687Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: ab7fcc9b-dbba-4d54-9ee5-c52185228a24, time_modified: Some(2024-11-05T00:06:20.802687Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59582024-11-05T00:06:20.813ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59592024-11-05T00:06:20.813ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59602024-11-05T00:06:20.816ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59612024-11-05T00:06:20.816ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59622024-11-05T00:06:20.819ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59632024-11-05T00:06:20.819ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = UnassignOximeterProducer
59642024-11-05T00:06:20.819ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = UnassignOximeterProducer
59652024-11-05T00:06:20.826ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 936f0bc7-d5c8-4edc-b21c-cc06e01960a5 producer_id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59662024-11-05T00:06:20.826ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = UnassignOximeterProducer
59672024-11-05T00:06:20.827ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = UnassignOximeterProducer
59682024-11-05T00:06:20.864ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:261 id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59692024-11-05T00:06:20.867ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/b39559fe-2123-48a9-99eb-12895a3c669f
59702024-11-05T00:06:20.887ZDEBGnexus (SagaExecutor): client response oximeter-collector = b39559fe-2123-48a9-99eb-12895a3c669f result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/b39559fe-2123-48a9-99eb-12895a3c669f", status: 204, headers: {"x-request-id": "ed5dfa35-4cbd-48bb-b03d-7b4a6c0c4db6", "date": "Tue, 05 Nov 2024 00:06:20 GMT"} }) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59712024-11-05T00:06:20.887ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 936f0bc7-d5c8-4edc-b21c-cc06e01960a5 producer_id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59722024-11-05T00:06:20.888ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59732024-11-05T00:06:20.888ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59742024-11-05T00:06:20.891ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59752024-11-05T00:06:20.891ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59762024-11-05T00:06:20.894ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = b39559fe-2123-48a9-99eb-12895a3c669f lock = UpdaterLock { updater_id: d60373c7-8ee2-4dfc-a5f4-ef9a03e01a45, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-05T00:06:20.641384744Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59772024-11-05T00:06:20.894ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = CommitInstanceUpdates
59782024-11-05T00:06:20.895ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = CommitInstanceUpdates
59792024-11-05T00:06:20.935ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f new_runtime = InstanceRuntimeState { time_updated: 2024-11-05T00:06:20.641384744Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
59802024-11-05T00:06:20.935ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59812024-11-05T00:06:20.935ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59822024-11-05T00:06:20.935ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
59832024-11-05T00:06:20.935ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
59842024-11-05T00:06:20.935ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59852024-11-05T00:06:20.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59862024-11-05T00:06:20.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59872024-11-05T00:06:20.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59882024-11-05T00:06:20.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59892024-11-05T00:06:20.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59902024-11-05T00:06:20.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59912024-11-05T00:06:20.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59922024-11-05T00:06:20.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59932024-11-05T00:06:20.940ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
59942024-11-05T00:06:20.940ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
59952024-11-05T00:06:20.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59962024-11-05T00:06:20.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59972024-11-05T00:06:20.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59982024-11-05T00:06:20.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59992024-11-05T00:06:20.944ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60002024-11-05T00:06:20.944ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("b39559fe-2123-48a9-99eb-12895a3c669f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("dae68a73-fee4-4624-be01-90976428e742")}) node_id = 7 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60012024-11-05T00:06:20.952ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60022024-11-05T00:06:20.952ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60032024-11-05T00:06:20.956ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60042024-11-05T00:06:20.956ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60052024-11-05T00:06:20.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0adaf28b-fe80-4352-a8f8-926d4d84a1b4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
60062024-11-05T00:06:20.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0adaf28b-fe80-4352-a8f8-926d4d84a1b4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
60072024-11-05T00:06:20.959ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60082024-11-05T00:06:20.959ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60092024-11-05T00:06:20.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0adaf28b-fe80-4352-a8f8-926d4d84a1b4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
60102024-11-05T00:06:20.963ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
60112024-11-05T00:06:20.963ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ReleaseSledResources
60122024-11-05T00:06:20.963ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ReleaseSledResources
60132024-11-05T00:06:20.967ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60142024-11-05T00:06:20.967ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60152024-11-05T00:06:20.971ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60162024-11-05T00:06:20.971ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60172024-11-05T00:06:20.974ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
60182024-11-05T00:06:20.974ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = MarkVmmDeleted
60192024-11-05T00:06:20.974ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = MarkVmmDeleted
60202024-11-05T00:06:20.985ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60212024-11-05T00:06:20.985ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60222024-11-05T00:06:20.988ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60232024-11-05T00:06:20.988ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60242024-11-05T00:06:20.992ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60252024-11-05T00:06:20.992ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60262024-11-05T00:06:20.995ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60272024-11-05T00:06:20.995ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60282024-11-05T00:06:21.003ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ChainSuccessorSaga
60292024-11-05T00:06:21.004ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ChainSuccessorSaga
60302024-11-05T00:06:21.006ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ChainSuccessorSaga
60312024-11-05T00:06:21.006ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ChainSuccessorSaga
60322024-11-05T00:06:21.007ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ChainSuccessorSaga
60332024-11-05T00:06:21.007ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ChainSuccessorSaga
60342024-11-05T00:06:21.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60352024-11-05T00:06:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60362024-11-05T00:06:21.034ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60372024-11-05T00:06:21.034ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60382024-11-05T00:06:21.034ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "63a2fa69-aea9-4b03-9b80-bf1b71393ff5", "content-length": "372", "date": "Tue, 05 Nov 2024 00:06:21 GMT"} })
60392024-11-05T00:06:21.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60402024-11-05T00:06:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60412024-11-05T00:06:21.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60422024-11-05T00:06:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60432024-11-05T00:06:21.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60442024-11-05T00:06:21.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60452024-11-05T00:06:21.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60462024-11-05T00:06:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60472024-11-05T00:06:21.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60482024-11-05T00:06:21.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60492024-11-05T00:06:21.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60502024-11-05T00:06:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60512024-11-05T00:06:21.062ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ChainSuccessorSaga
60522024-11-05T00:06:21.066ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, lookup_type: ById(73cac2e6-afc3-4b45-b597-79dfc81e8ecd) }, key: ab7fcc9b-dbba-4d54-9ee5-c52185228a24, lookup_type: ById(ab7fcc9b-dbba-4d54-9ee5-c52185228a24) }, key: b39559fe-2123-48a9-99eb-12895a3c669f, lookup_type: ById(b39559fe-2123-48a9-99eb-12895a3c669f) } result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ChainSuccessorSaga
60532024-11-05T00:06:21.066ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ChainSuccessorSaga
60542024-11-05T00:06:21.066ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_node = ChainSuccessorSaga
60552024-11-05T00:06:21.074ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = b39559fe-2123-48a9-99eb-12895a3c669f karmic_state = WillReincarnate needs_reincarnation = false saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update
60562024-11-05T00:06:21.074ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60572024-11-05T00:06:21.074ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60582024-11-05T00:06:21.076ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
60592024-11-05T00:06:21.076ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60602024-11-05T00:06:21.077ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7f598c18-9c70-42ca-9244-c35775abbed1", "date": "Tue, 05 Nov 2024 00:06:21 GMT"} })
60612024-11-05T00:06:21.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60622024-11-05T00:06:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60632024-11-05T00:06:21.077ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60642024-11-05T00:06:21.077ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60652024-11-05T00:06:21.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60662024-11-05T00:06:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60672024-11-05T00:06:21.081ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60682024-11-05T00:06:21.081ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60692024-11-05T00:06:21.082ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60702024-11-05T00:06:21.083ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f73aa0ff-9fe0-4552-8703-c27e201714c3", "content-length": "691", "date": "Tue, 05 Nov 2024 00:06:21 GMT"} })
60712024-11-05T00:06:21.083ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60722024-11-05T00:06:21.083ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60732024-11-05T00:06:21.083ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60742024-11-05T00:06:21.085ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 149.442818ms iteration = 25 status = {}
60752024-11-05T00:06:21.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60762024-11-05T00:06:21.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60772024-11-05T00:06:21.086ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60782024-11-05T00:06:21.086ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a
60792024-11-05T00:06:21.089ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60802024-11-05T00:06:21.089ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60812024-11-05T00:06:21.089ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1ab16fe3-c293-4165-9861-9c842d9e8ec7", "date": "Tue, 05 Nov 2024 00:06:21 GMT"} })
60822024-11-05T00:06:21.090ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 154.973081ms iteration = 25 status = {}
60832024-11-05T00:06:21.118ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60842024-11-05T00:06:21.118ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a saga_name = instance-update saga_result = SagaResult { saga_id: 780c3287-5ec1-48b1-a901-8a8b5df2775a, saga_log: SagaLog { saga_id: 780c3287-5ec1-48b1-a901-8a8b5df2775a, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("d60373c7-8ee2-4dfc-a5f4-ef9a03e01a45")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("d60373c7-8ee2-4dfc-a5f4-ef9a03e01a45")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("b39559fe-2123-48a9-99eb-12895a3c669f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("dae68a73-fee4-4624-be01-90976428e742")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("b39559fe-2123-48a9-99eb-12895a3c669f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("dae68a73-fee4-4624-be01-90976428e742")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("d60373c7-8ee2-4dfc-a5f4-ef9a03e01a45"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("d60373c7-8ee2-4dfc-a5f4-ef9a03e01a45")}} }) }
60852024-11-05T00:06:21.118ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 780c3287-5ec1-48b1-a901-8a8b5df2775a instance_id = b39559fe-2123-48a9-99eb-12895a3c669f saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update
60862024-11-05T00:06:21.118ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60872024-11-05T00:06:21.118ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
60882024-11-05T00:06:21.122ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60892024-11-05T00:06:21.122ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
60902024-11-05T00:06:21.126ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60912024-11-05T00:06:21.126ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
60922024-11-05T00:06:21.129ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60932024-11-05T00:06:21.129ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59
60942024-11-05T00:06:21.165ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update sec_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
60952024-11-05T00:06:21.165ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = dffe3ee2-db54-4023-b20f-2ea00bff0b59 saga_name = start-instance-update saga_result = SagaResult { saga_id: dffe3ee2-db54-4023-b20f-2ea00bff0b59, saga_log: SagaLog { saga_id: dffe3ee2-db54-4023-b20f-2ea00bff0b59, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("607bb6ed-8e3a-44cd-8351-c8ff10ae5b64")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("607bb6ed-8e3a-44cd-8351-c8ff10ae5b64")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("607bb6ed-8e3a-44cd-8351-c8ff10ae5b64"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("607bb6ed-8e3a-44cd-8351-c8ff10ae5b64")}} }) }
60962024-11-05T00:06:21.884ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3295 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 8498f56b-68e8-4f3a-a8b3-3c4d68fe5937 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
60972024-11-05T00:06:21.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b5ea4371-a51b-4f23-a104-c14fc8c18822 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
60982024-11-05T00:06:21.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b5ea4371-a51b-4f23-a104-c14fc8c18822 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
60992024-11-05T00:06:21.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b5ea4371-a51b-4f23-a104-c14fc8c18822 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61002024-11-05T00:06:22.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
61012024-11-05T00:06:22.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61022024-11-05T00:06:22.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
61032024-11-05T00:06:22.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61042024-11-05T00:06:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61052024-11-05T00:06:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61062024-11-05T00:06:22.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61072024-11-05T00:06:22.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61082024-11-05T00:06:22.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61092024-11-05T00:06:22.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61102024-11-05T00:06:22.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61112024-11-05T00:06:22.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61122024-11-05T00:06:22.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61132024-11-05T00:06:22.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61142024-11-05T00:06:22.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.839201ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61152024-11-05T00:06:22.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61162024-11-05T00:06:22.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
61172024-11-05T00:06:22.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61182024-11-05T00:06:22.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61192024-11-05T00:06:22.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
61202024-11-05T00:06:22.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.392931ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
61212024-11-05T00:06:23.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 03685660-0694-46f0-bff2-3ab99011bce0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61222024-11-05T00:06:23.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 03685660-0694-46f0-bff2-3ab99011bce0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61232024-11-05T00:06:23.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 03685660-0694-46f0-bff2-3ab99011bce0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61242024-11-05T00:06:24.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 832df60a-7c96-4d7e-907d-df09a55a3227 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61252024-11-05T00:06:24.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 832df60a-7c96-4d7e-907d-df09a55a3227 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61262024-11-05T00:06:24.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 832df60a-7c96-4d7e-907d-df09a55a3227 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61272024-11-05T00:06:25.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 28a36075-ac0f-49bf-9487-adf357ea34a4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61282024-11-05T00:06:25.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 28a36075-ac0f-49bf-9487-adf357ea34a4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61292024-11-05T00:06:25.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 28a36075-ac0f-49bf-9487-adf357ea34a4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61302024-11-05T00:06:26.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1f784898-607a-4166-9c64-0f003cc8502a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61312024-11-05T00:06:26.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1f784898-607a-4166-9c64-0f003cc8502a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61322024-11-05T00:06:26.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2499 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1f784898-607a-4166-9c64-0f003cc8502a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61332024-11-05T00:06:27.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9222bd06-eee7-4288-8aa1-24053d306a45 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61342024-11-05T00:06:27.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9222bd06-eee7-4288-8aa1-24053d306a45 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61352024-11-05T00:06:27.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9222bd06-eee7-4288-8aa1-24053d306a45 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61362024-11-05T00:06:28.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d7728bf4-d2a1-4d0d-b114-562e8b4ebc9d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61372024-11-05T00:06:28.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d7728bf4-d2a1-4d0d-b114-562e8b4ebc9d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61382024-11-05T00:06:28.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d7728bf4-d2a1-4d0d-b114-562e8b4ebc9d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61392024-11-05T00:06:29.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 137080c6-4590-44ab-a95a-86bca917d74c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61402024-11-05T00:06:29.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 137080c6-4590-44ab-a95a-86bca917d74c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61412024-11-05T00:06:29.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 137080c6-4590-44ab-a95a-86bca917d74c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61422024-11-05T00:06:30.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 20a2a73b-2e10-406b-b61d-e63aceb1f8e5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61432024-11-05T00:06:30.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 20a2a73b-2e10-406b-b61d-e63aceb1f8e5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61442024-11-05T00:06:30.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 20a2a73b-2e10-406b-b61d-e63aceb1f8e5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61452024-11-05T00:06:31.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f19a4f57-c83b-4a21-a98e-1ac68cceea39 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61462024-11-05T00:06:31.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f19a4f57-c83b-4a21-a98e-1ac68cceea39 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61472024-11-05T00:06:31.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f19a4f57-c83b-4a21-a98e-1ac68cceea39 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61482024-11-05T00:06:32.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
61492024-11-05T00:06:32.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
61502024-11-05T00:06:32.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61512024-11-05T00:06:32.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61522024-11-05T00:06:32.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61532024-11-05T00:06:32.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61542024-11-05T00:06:32.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61552024-11-05T00:06:32.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61562024-11-05T00:06:32.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61572024-11-05T00:06:32.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61582024-11-05T00:06:32.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61592024-11-05T00:06:32.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61602024-11-05T00:06:32.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.691537ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61612024-11-05T00:06:32.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61622024-11-05T00:06:32.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61632024-11-05T00:06:32.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61642024-11-05T00:06:32.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
61652024-11-05T00:06:32.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61662024-11-05T00:06:32.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61672024-11-05T00:06:32.190ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
61682024-11-05T00:06:32.190ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.02692ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
61692024-11-05T00:06:32.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a3ba1a34-cd1d-4ec2-a301-60288ec6dbfb roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61702024-11-05T00:06:32.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a3ba1a34-cd1d-4ec2-a301-60288ec6dbfb resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61712024-11-05T00:06:32.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a3ba1a34-cd1d-4ec2-a301-60288ec6dbfb response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61722024-11-05T00:06:33.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1dbe4381-a545-45cf-b7ac-28154a544628 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61732024-11-05T00:06:33.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1dbe4381-a545-45cf-b7ac-28154a544628 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61742024-11-05T00:06:33.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1dbe4381-a545-45cf-b7ac-28154a544628 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61752024-11-05T00:06:34.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fe6caa38-7dd9-4d9f-b551-3d183999dd6a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61762024-11-05T00:06:34.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fe6caa38-7dd9-4d9f-b551-3d183999dd6a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61772024-11-05T00:06:34.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fe6caa38-7dd9-4d9f-b551-3d183999dd6a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61782024-11-05T00:06:35.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d7498509-c357-48eb-b1bb-6be9a23deea6 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61792024-11-05T00:06:35.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d7498509-c357-48eb-b1bb-6be9a23deea6 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61802024-11-05T00:06:35.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d7498509-c357-48eb-b1bb-6be9a23deea6 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61812024-11-05T00:06:36.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6f0a7823-f83d-4e15-bed6-57cf89876583 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61822024-11-05T00:06:36.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6f0a7823-f83d-4e15-bed6-57cf89876583 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61832024-11-05T00:06:36.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6f0a7823-f83d-4e15-bed6-57cf89876583 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61842024-11-05T00:06:36.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 647 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = d9e89cdb-8f09-4387-a2c2-bb35133cff41 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
61852024-11-05T00:06:37.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9aefe75d-dc35-4381-b169-75c89bcf63e4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61862024-11-05T00:06:37.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9aefe75d-dc35-4381-b169-75c89bcf63e4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61872024-11-05T00:06:37.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9aefe75d-dc35-4381-b169-75c89bcf63e4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61882024-11-05T00:06:38.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = df24a333-32a2-46b2-a209-2fa66525f47b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61892024-11-05T00:06:38.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = df24a333-32a2-46b2-a209-2fa66525f47b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61902024-11-05T00:06:38.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = df24a333-32a2-46b2-a209-2fa66525f47b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61912024-11-05T00:06:39.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f3d85252-64fb-4372-998f-d07695fcc457 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61922024-11-05T00:06:39.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f3d85252-64fb-4372-998f-d07695fcc457 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61932024-11-05T00:06:39.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f3d85252-64fb-4372-998f-d07695fcc457 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61942024-11-05T00:06:40.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3eb5c9e3-e70e-4fef-88e4-bb977176a06f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61952024-11-05T00:06:40.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3eb5c9e3-e70e-4fef-88e4-bb977176a06f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61962024-11-05T00:06:40.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3eb5c9e3-e70e-4fef-88e4-bb977176a06f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61972024-11-05T00:06:41.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5abe88f3-3e01-4584-9214-c90d9b64b342 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61982024-11-05T00:06:41.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5abe88f3-3e01-4584-9214-c90d9b64b342 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
61992024-11-05T00:06:41.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5abe88f3-3e01-4584-9214-c90d9b64b342 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
62002024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
62012024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62022024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
62032024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62042024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
62052024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62062024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
62072024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62082024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
62092024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
62102024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62112024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62122024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
62132024-11-05T00:06:42.172ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-04 23:56:42.172830368 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
62142024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
62152024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
62162024-11-05T00:06:42.172ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
62172024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
62182024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62192024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62202024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
62212024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62222024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
62232024-11-05T00:06:42.172ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
62242024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62252024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
62262024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
62272024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62282024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
62292024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
62302024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62312024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62322024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
62332024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
62342024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
62352024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62362024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
62372024-11-05T00:06:42.173ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970
62382024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
62392024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62402024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.311\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970"}
62412024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
62422024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
62432024-11-05T00:06:42.173ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62442024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62452024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62462024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
62472024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
62482024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
62492024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62502024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62512024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
62522024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62532024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62542024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62552024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62562024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62572024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62582024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62592024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62602024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62612024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62622024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62632024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62642024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
62652024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
62662024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.471\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
62672024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
62682024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
62692024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.61\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
62702024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
62712024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
62722024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
62732024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62742024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.7\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
62752024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
62762024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.53\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
62772024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62782024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62792024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62802024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62812024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62822024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62832024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62842024-11-05T00:06:42.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("08f058bf-bffa-4561-8799-2d5d32641d33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e5a3f00-3f5b-4cac-8aa4-99515a0afee2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3045, tv_nsec: 759319532 } })
62852024-11-05T00:06:42.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f4c9dd5-dad6-4fc2-ba58-b064adbea295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3045, tv_nsec: 759330112 } })
62862024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62872024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62882024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62892024-11-05T00:06:42.173ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62902024-11-05T00:06:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62912024-11-05T00:06:42.174ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62922024-11-05T00:06:42.174ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
62932024-11-05T00:06:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.215895ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
62942024-11-05T00:06:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62952024-11-05T00:06:42.174ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62962024-11-05T00:06:42.174ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
62972024-11-05T00:06:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.161024ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
62982024-11-05T00:06:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62992024-11-05T00:06:42.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3045, tv_nsec: 761542378 } })
63002024-11-05T00:06:42.176ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
63012024-11-05T00:06:42.177ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-04 23:56:42.172830368 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
63022024-11-05T00:06:42.177ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.37169ms iteration = 13 status = {"expiration":"2024-11-04T23:56:42.172830368Z","pruned":[]}
63032024-11-05T00:06:42.177ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.577404ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63042024-11-05T00:06:42.178ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63052024-11-05T00:06:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63062024-11-05T00:06:42.179ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63072024-11-05T00:06:42.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63082024-11-05T00:06:42.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
63092024-11-05T00:06:42.181ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63102024-11-05T00:06:42.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63112024-11-05T00:06:42.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63122024-11-05T00:06:42.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63132024-11-05T00:06:42.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63142024-11-05T00:06:42.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3045, tv_nsec: 772926282 } })
63152024-11-05T00:06:42.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
63162024-11-05T00:06:42.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63172024-11-05T00:06:42.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63182024-11-05T00:06:42.190ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63192024-11-05T00:06:42.192ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.50815ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
63202024-11-05T00:06:42.193ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63212024-11-05T00:06:42.193ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63222024-11-05T00:06:42.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63232024-11-05T00:06:42.196ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63242024-11-05T00:06:42.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63252024-11-05T00:06:42.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63262024-11-05T00:06:42.198ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63272024-11-05T00:06:42.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63282024-11-05T00:06:42.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63292024-11-05T00:06:42.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63302024-11-05T00:06:42.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63312024-11-05T00:06:42.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63322024-11-05T00:06:42.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63332024-11-05T00:06:42.220ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63342024-11-05T00:06:42.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63352024-11-05T00:06:42.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63362024-11-05T00:06:42.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63372024-11-05T00:06:42.228ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63382024-11-05T00:06:42.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63392024-11-05T00:06:42.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63402024-11-05T00:06:42.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63412024-11-05T00:06:42.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63422024-11-05T00:06:42.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63432024-11-05T00:06:42.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63442024-11-05T00:06:42.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63452024-11-05T00:06:42.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63462024-11-05T00:06:42.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63472024-11-05T00:06:42.239ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63482024-11-05T00:06:42.239ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63492024-11-05T00:06:42.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63502024-11-05T00:06:42.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63512024-11-05T00:06:42.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63522024-11-05T00:06:42.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63532024-11-05T00:06:42.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63542024-11-05T00:06:42.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63552024-11-05T00:06:42.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63562024-11-05T00:06:42.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63572024-11-05T00:06:42.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3045, tv_nsec: 828564474 } })
63582024-11-05T00:06:42.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63592024-11-05T00:06:42.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
63602024-11-05T00:06:42.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63612024-11-05T00:06:42.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63622024-11-05T00:06:42.244ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63632024-11-05T00:06:42.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63642024-11-05T00:06:42.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63652024-11-05T00:06:42.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63662024-11-05T00:06:42.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63672024-11-05T00:06:42.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63682024-11-05T00:06:42.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63692024-11-05T00:06:42.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63702024-11-05T00:06:42.246ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
63712024-11-05T00:06:42.246ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
63722024-11-05T00:06:42.246ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.59573ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
63732024-11-05T00:06:42.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63742024-11-05T00:06:42.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63752024-11-05T00:06:42.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63762024-11-05T00:06:42.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63772024-11-05T00:06:42.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63782024-11-05T00:06:42.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63792024-11-05T00:06:42.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63802024-11-05T00:06:42.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63812024-11-05T00:06:42.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
63822024-11-05T00:06:42.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63832024-11-05T00:06:42.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63842024-11-05T00:06:42.255ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63852024-11-05T00:06:42.255ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63862024-11-05T00:06:42.255ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.702687ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63872024-11-05T00:06:42.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63882024-11-05T00:06:42.257ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63892024-11-05T00:06:42.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63902024-11-05T00:06:42.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63912024-11-05T00:06:42.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63922024-11-05T00:06:42.261ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63932024-11-05T00:06:42.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63942024-11-05T00:06:42.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63952024-11-05T00:06:42.261ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63962024-11-05T00:06:42.261ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63972024-11-05T00:06:42.261ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63982024-11-05T00:06:42.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63992024-11-05T00:06:42.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64002024-11-05T00:06:42.262ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64012024-11-05T00:06:42.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64022024-11-05T00:06:42.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64032024-11-05T00:06:42.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64042024-11-05T00:06:42.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64052024-11-05T00:06:42.265ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64062024-11-05T00:06:42.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64072024-11-05T00:06:42.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64082024-11-05T00:06:42.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64092024-11-05T00:06:42.265ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64102024-11-05T00:06:42.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64112024-11-05T00:06:42.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64122024-11-05T00:06:42.268ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64132024-11-05T00:06:42.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64142024-11-05T00:06:42.271ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64152024-11-05T00:06:42.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64162024-11-05T00:06:42.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64172024-11-05T00:06:42.273ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 100.474802ms iteration = 6 status = {"nsuccess":5}
64182024-11-05T00:06:42.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64192024-11-05T00:06:42.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64202024-11-05T00:06:42.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64212024-11-05T00:06:42.286ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
64222024-11-05T00:06:42.286ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
64232024-11-05T00:06:42.286ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
64242024-11-05T00:06:42.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64252024-11-05T00:06:42.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64262024-11-05T00:06:42.286ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
64272024-11-05T00:06:42.287ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.182243ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
64282024-11-05T00:06:42.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64292024-11-05T00:06:42.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64302024-11-05T00:06:42.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 123.003404ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64312024-11-05T00:06:42.298ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64322024-11-05T00:06:42.298ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64332024-11-05T00:06:42.298ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64342024-11-05T00:06:42.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64352024-11-05T00:06:42.306ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64362024-11-05T00:06:42.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64372024-11-05T00:06:42.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 141.199778ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64382024-11-05T00:06:42.319ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
64392024-11-05T00:06:42.319ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 146.510557ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
64402024-11-05T00:06:42.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
64412024-11-05T00:06:42.338ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64422024-11-05T00:06:42.338ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "356ed609-e85b-4e2b-bcb0-7100d67e0ede", "content-length": "26", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
64432024-11-05T00:06:42.338ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64442024-11-05T00:06:42.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64452024-11-05T00:06:42.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64462024-11-05T00:06:42.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64472024-11-05T00:06:42.358ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
64482024-11-05T00:06:42.375ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
64492024-11-05T00:06:42.375ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64502024-11-05T00:06:42.375ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da0a83f4-9310-4450-b8d2-9df7455e7503", "content-length": "26", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
64512024-11-05T00:06:42.375ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64522024-11-05T00:06:42.377ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64532024-11-05T00:06:42.407ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 234.781469ms iteration = 28 status = {"physical_disks_added":0}
64542024-11-05T00:06:42.429ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64552024-11-05T00:06:42.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3799cb9f-c835-48da-8fee-bab69de15991 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
64562024-11-05T00:06:42.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3799cb9f-c835-48da-8fee-bab69de15991 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
64572024-11-05T00:06:42.534ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64582024-11-05T00:06:42.534ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64592024-11-05T00:06:42.535ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8766b6cf-595e-4ed5-89b0-7a311f73a433", "content-length": "372", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
64602024-11-05T00:06:42.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64612024-11-05T00:06:42.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64622024-11-05T00:06:42.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64632024-11-05T00:06:42.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64642024-11-05T00:06:42.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3799cb9f-c835-48da-8fee-bab69de15991 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
64652024-11-05T00:06:42.541ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
64662024-11-05T00:06:42.541ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64672024-11-05T00:06:42.542ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64682024-11-05T00:06:42.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64692024-11-05T00:06:42.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64702024-11-05T00:06:42.542ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "264796cc-2942-411d-8d14-f4f1aed0d37f", "content-length": "26", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
64712024-11-05T00:06:42.542ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64722024-11-05T00:06:42.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64732024-11-05T00:06:42.542ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "af793bca-6060-41fe-8dbd-8df0be9a937e", "content-length": "2", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
64742024-11-05T00:06:42.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64752024-11-05T00:06:42.543ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64762024-11-05T00:06:42.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64772024-11-05T00:06:42.545ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
64782024-11-05T00:06:42.546ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64792024-11-05T00:06:42.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64802024-11-05T00:06:42.549ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 376.938477ms iteration = 25 status = null
64812024-11-05T00:06:42.562ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64822024-11-05T00:06:42.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64832024-11-05T00:06:42.578ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64842024-11-05T00:06:42.578ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64852024-11-05T00:06:42.578ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 405.957963ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64862024-11-05T00:06:42.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
64872024-11-05T00:06:42.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64882024-11-05T00:06:42.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64892024-11-05T00:06:42.584ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 411.511077ms iteration = 25 status = 0
64902024-11-05T00:06:42.584ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 411.299143ms iteration = 25 status = {}
64912024-11-05T00:06:42.584ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64922024-11-05T00:06:42.584ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 0 version = 2
64932024-11-05T00:06:42.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64942024-11-05T00:06:42.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64952024-11-05T00:06:42.592ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-04T23:54:39.943212Z, time_modified: 2024-11-04T23:54:39.943212Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
64962024-11-05T00:06:42.592ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 419.780397ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]}},"default_endpoint":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64972024-11-05T00:06:42.595ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64982024-11-05T00:06:42.595ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64992024-11-05T00:06:42.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65002024-11-05T00:06:42.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65012024-11-05T00:06:42.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65022024-11-05T00:06:42.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65032024-11-05T00:06:42.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65042024-11-05T00:06:42.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65052024-11-05T00:06:42.619ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
65062024-11-05T00:06:42.619ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
65072024-11-05T00:06:42.619ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
65082024-11-05T00:06:42.619ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "28f1c214-4dde-4707-a964-e03d321aebdf", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65092024-11-05T00:06:42.619ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65102024-11-05T00:06:42.620ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ec365f18-23f2-4c3c-a3b6-160feebdcc96", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
65112024-11-05T00:06:42.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65122024-11-05T00:06:42.621ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 1 version = 2
65132024-11-05T00:06:42.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65142024-11-05T00:06:42.621ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
65152024-11-05T00:06:42.621ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-04 23:54:45.073528 UTC dns_group = external generation = 2
65162024-11-05T00:06:42.621ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 448.421795ms iteration = 13 status = {"generation":2}
65172024-11-05T00:06:42.621ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "54f6d55e-6605-4c27-aeea-c31207422575", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65182024-11-05T00:06:42.621ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65192024-11-05T00:06:42.623ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65202024-11-05T00:06:42.623ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 450.927016ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
65212024-11-05T00:06:42.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65222024-11-05T00:06:42.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65232024-11-05T00:06:42.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65242024-11-05T00:06:42.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65252024-11-05T00:06:42.636ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65262024-11-05T00:06:42.636ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65272024-11-05T00:06:42.637ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ba21be53-8129-4a37-a03b-81c88f21c5ea", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
65282024-11-05T00:06:42.639ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 466.000556ms iteration = 26 status = {}
65292024-11-05T00:06:42.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65302024-11-05T00:06:42.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65312024-11-05T00:06:42.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65322024-11-05T00:06:42.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65332024-11-05T00:06:42.648ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
65342024-11-05T00:06:42.648ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
65352024-11-05T00:06:42.648ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-04 23:54:43.769339 UTC dns_group = internal generation = 1
65362024-11-05T00:06:42.648ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 475.642853ms iteration = 13 status = {"generation":1}
65372024-11-05T00:06:42.651ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
65382024-11-05T00:06:42.651ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "57e5a25d-c8cf-4afd-90ce-f280b25e48fd", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65392024-11-05T00:06:42.651ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65402024-11-05T00:06:42.653ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5358ba03-4da3-4eba-8f6b-ef1483fac3d1", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65412024-11-05T00:06:42.653ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65422024-11-05T00:06:42.656ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c9b79e0c-5c72-4711-adff-540e1d73bc37", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65432024-11-05T00:06:42.656ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65442024-11-05T00:06:42.658ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65452024-11-05T00:06:42.658ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 485.072207ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
65462024-11-05T00:06:42.658ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
65472024-11-05T00:06:42.658ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 485.026676ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
65482024-11-05T00:06:42.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65492024-11-05T00:06:42.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65502024-11-05T00:06:42.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65512024-11-05T00:06:42.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65522024-11-05T00:06:42.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65532024-11-05T00:06:42.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65542024-11-05T00:06:42.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65552024-11-05T00:06:42.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65562024-11-05T00:06:42.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65572024-11-05T00:06:42.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65582024-11-05T00:06:42.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65592024-11-05T00:06:42.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65602024-11-05T00:06:42.713ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
65612024-11-05T00:06:42.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65622024-11-05T00:06:42.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65632024-11-05T00:06:42.725ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65642024-11-05T00:06:42.725ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee1dae4c-8fb2-4a80-add0-7aa208647e0e", "content-length": "134", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
65652024-11-05T00:06:42.725ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65662024-11-05T00:06:42.725ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
65672024-11-05T00:06:42.725ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65682024-11-05T00:06:42.725ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65692024-11-05T00:06:42.725ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65702024-11-05T00:06:42.725ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65712024-11-05T00:06:42.725ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65722024-11-05T00:06:42.725ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65732024-11-05T00:06:42.725ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65742024-11-05T00:06:42.725ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65752024-11-05T00:06:42.726ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
65762024-11-05T00:06:42.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65772024-11-05T00:06:42.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65782024-11-05T00:06:42.728ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65792024-11-05T00:06:42.728ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "caf5d931-5452-4057-98ff-afb3d5557903", "content-length": "2", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
65802024-11-05T00:06:42.728ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65812024-11-05T00:06:42.729ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a733171-70e6-4b98-9c38-b5b1ec9ee675", "content-length": "52", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
65822024-11-05T00:06:42.729ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
65832024-11-05T00:06:42.729ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65842024-11-05T00:06:42.782ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65852024-11-05T00:06:42.840ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c22468b-2d58-4788-969a-215931f5e05e", "content-length": "691", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
65862024-11-05T00:06:42.840ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
65872024-11-05T00:06:42.840ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
65882024-11-05T00:06:42.840ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
65892024-11-05T00:06:42.841ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 668.577605ms iteration = 26 status = {}
65902024-11-05T00:06:42.958ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7114c4d0-4fbe-4374-926e-d322ee5e2b28", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
65912024-11-05T00:06:42.958ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
65922024-11-05T00:06:42.958ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65932024-11-05T00:06:42.958ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d09f3f3-616e-436a-8a8e-344b26033c65", "content-length": "682", "date": "Tue, 05 Nov 2024 00:06:42 GMT"} })
65942024-11-05T00:06:42.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65952024-11-05T00:06:42.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65962024-11-05T00:06:42.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65972024-11-05T00:06:42.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65982024-11-05T00:06:42.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65992024-11-05T00:06:42.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66002024-11-05T00:06:42.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66012024-11-05T00:06:42.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66022024-11-05T00:06:42.973ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 800.921851ms iteration = 25 status = {}
66032024-11-05T00:06:43.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c4f27ac7-e8d9-4f27-9db6-5ddc9c0f18dd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66042024-11-05T00:06:43.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c4f27ac7-e8d9-4f27-9db6-5ddc9c0f18dd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66052024-11-05T00:06:43.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c4f27ac7-e8d9-4f27-9db6-5ddc9c0f18dd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66062024-11-05T00:06:44.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fe5da653-cb95-4432-a520-a2d1e3e0f739 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66072024-11-05T00:06:44.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fe5da653-cb95-4432-a520-a2d1e3e0f739 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66082024-11-05T00:06:44.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fe5da653-cb95-4432-a520-a2d1e3e0f739 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66092024-11-05T00:06:45.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6180ac02-920d-46a1-8487-f6f68e455ce4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66102024-11-05T00:06:45.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6180ac02-920d-46a1-8487-f6f68e455ce4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66112024-11-05T00:06:45.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6180ac02-920d-46a1-8487-f6f68e455ce4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66122024-11-05T00:06:46.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f744c834-713c-41ae-92b9-69eb228e0c23 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66132024-11-05T00:06:46.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f744c834-713c-41ae-92b9-69eb228e0c23 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66142024-11-05T00:06:46.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f744c834-713c-41ae-92b9-69eb228e0c23 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66152024-11-05T00:06:47.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0da04cca-9ffb-4a0a-99b3-1e892fb68543 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66162024-11-05T00:06:47.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0da04cca-9ffb-4a0a-99b3-1e892fb68543 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66172024-11-05T00:06:47.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0da04cca-9ffb-4a0a-99b3-1e892fb68543 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66182024-11-05T00:06:48.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d6bfd7a-86f4-4963-bfad-1d50c0b6d384 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66192024-11-05T00:06:48.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d6bfd7a-86f4-4963-bfad-1d50c0b6d384 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66202024-11-05T00:06:48.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7d6bfd7a-86f4-4963-bfad-1d50c0b6d384 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66212024-11-05T00:06:49.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c85acd7d-576e-4dac-9443-58e46736259c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66222024-11-05T00:06:49.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c85acd7d-576e-4dac-9443-58e46736259c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66232024-11-05T00:06:49.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c85acd7d-576e-4dac-9443-58e46736259c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66242024-11-05T00:06:50.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 22724764-0b7d-4175-8e1a-949427cb4296 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66252024-11-05T00:06:50.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 22724764-0b7d-4175-8e1a-949427cb4296 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66262024-11-05T00:06:50.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 22724764-0b7d-4175-8e1a-949427cb4296 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66272024-11-05T00:06:51.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bfbf5dd3-8b48-4624-9cbf-7e0219b984ce roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66282024-11-05T00:06:51.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bfbf5dd3-8b48-4624-9cbf-7e0219b984ce resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66292024-11-05T00:06:51.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bfbf5dd3-8b48-4624-9cbf-7e0219b984ce response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66302024-11-05T00:06:51.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1079 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 4ef7c408-0047-44f2-91d8-2cdeead6e860 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
66312024-11-05T00:06:52.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
66322024-11-05T00:06:52.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66332024-11-05T00:06:52.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
66342024-11-05T00:06:52.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66352024-11-05T00:06:52.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66362024-11-05T00:06:52.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66372024-11-05T00:06:52.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66382024-11-05T00:06:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66392024-11-05T00:06:52.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66402024-11-05T00:06:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66412024-11-05T00:06:52.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66422024-11-05T00:06:52.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66432024-11-05T00:06:52.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66442024-11-05T00:06:52.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
66452024-11-05T00:06:52.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66462024-11-05T00:06:52.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66472024-11-05T00:06:52.196ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
66482024-11-05T00:06:52.196ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.552823ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
66492024-11-05T00:06:52.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66502024-11-05T00:06:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66512024-11-05T00:06:52.229ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.219855ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66522024-11-05T00:06:52.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1685c2b3-852b-43d9-af76-261ca8203a15 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66532024-11-05T00:06:52.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1685c2b3-852b-43d9-af76-261ca8203a15 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66542024-11-05T00:06:52.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1685c2b3-852b-43d9-af76-261ca8203a15 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66552024-11-05T00:06:53.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b1550f7b-42f8-4a96-ac1f-db10169c89dd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66562024-11-05T00:06:53.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b1550f7b-42f8-4a96-ac1f-db10169c89dd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66572024-11-05T00:06:53.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b1550f7b-42f8-4a96-ac1f-db10169c89dd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66582024-11-05T00:06:54.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ffdfeecd-6e36-422c-bd4a-637f6504c61f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66592024-11-05T00:06:54.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ffdfeecd-6e36-422c-bd4a-637f6504c61f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66602024-11-05T00:06:54.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ffdfeecd-6e36-422c-bd4a-637f6504c61f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66612024-11-05T00:06:55.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7072f271-d6c1-49e5-8804-d67a875e6caf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66622024-11-05T00:06:55.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7072f271-d6c1-49e5-8804-d67a875e6caf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66632024-11-05T00:06:55.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7072f271-d6c1-49e5-8804-d67a875e6caf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66642024-11-05T00:06:56.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fcea0c83-24f4-40bc-8fc1-278cbafe73d3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66652024-11-05T00:06:56.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fcea0c83-24f4-40bc-8fc1-278cbafe73d3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66662024-11-05T00:06:56.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fcea0c83-24f4-40bc-8fc1-278cbafe73d3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66672024-11-05T00:06:57.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac90e198-beeb-4386-9418-26706ae4529f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66682024-11-05T00:06:57.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac90e198-beeb-4386-9418-26706ae4529f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66692024-11-05T00:06:57.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac90e198-beeb-4386-9418-26706ae4529f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66702024-11-05T00:06:58.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 707920ba-5ba5-420d-a26a-bf63086a177a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66712024-11-05T00:06:58.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 707920ba-5ba5-420d-a26a-bf63086a177a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66722024-11-05T00:06:58.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 707920ba-5ba5-420d-a26a-bf63086a177a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66732024-11-05T00:06:59.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3b83fef2-f26a-4482-9826-0b8b6960e122 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66742024-11-05T00:06:59.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3b83fef2-f26a-4482-9826-0b8b6960e122 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66752024-11-05T00:06:59.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3b83fef2-f26a-4482-9826-0b8b6960e122 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66762024-11-05T00:07:00.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2e2b2835-bb56-41ac-9ca2-d4112ff3eacb roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66772024-11-05T00:07:00.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2e2b2835-bb56-41ac-9ca2-d4112ff3eacb resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66782024-11-05T00:07:00.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2e2b2835-bb56-41ac-9ca2-d4112ff3eacb response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66792024-11-05T00:07:01.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c4574910-f78a-4503-81ac-ce925ec8d6f5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66802024-11-05T00:07:01.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c4574910-f78a-4503-81ac-ce925ec8d6f5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66812024-11-05T00:07:02.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c4574910-f78a-4503-81ac-ce925ec8d6f5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
66822024-11-05T00:07:02.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
66832024-11-05T00:07:02.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
66842024-11-05T00:07:02.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66852024-11-05T00:07:02.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66862024-11-05T00:07:02.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66872024-11-05T00:07:02.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66882024-11-05T00:07:02.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66892024-11-05T00:07:02.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66902024-11-05T00:07:02.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66912024-11-05T00:07:02.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66922024-11-05T00:07:02.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66932024-11-05T00:07:02.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66942024-11-05T00:07:02.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66952024-11-05T00:07:02.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66962024-11-05T00:07:02.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66972024-11-05T00:07:02.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
66982024-11-05T00:07:02.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66992024-11-05T00:07:02.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67002024-11-05T00:07:02.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
67012024-11-05T00:07:02.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.917375ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
67022024-11-05T00:07:02.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.94086ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67032024-11-05T00:07:03.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c8468951-7967-4b01-a031-d49f75fb8329 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67042024-11-05T00:07:03.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c8468951-7967-4b01-a031-d49f75fb8329 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67052024-11-05T00:07:03.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c8468951-7967-4b01-a031-d49f75fb8329 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67062024-11-05T00:07:04.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f2f4954a-6166-4f4a-9ab5-85398a14c1c8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67072024-11-05T00:07:04.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f2f4954a-6166-4f4a-9ab5-85398a14c1c8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67082024-11-05T00:07:04.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f2f4954a-6166-4f4a-9ab5-85398a14c1c8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67092024-11-05T00:07:05.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a283b93c-8b0d-4327-9422-e9b616ca6c92 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67102024-11-05T00:07:05.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a283b93c-8b0d-4327-9422-e9b616ca6c92 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67112024-11-05T00:07:05.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a283b93c-8b0d-4327-9422-e9b616ca6c92 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67122024-11-05T00:07:06.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 030459a2-3cb6-46d3-af0e-83fb569ea49e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67132024-11-05T00:07:06.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 030459a2-3cb6-46d3-af0e-83fb569ea49e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67142024-11-05T00:07:06.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 030459a2-3cb6-46d3-af0e-83fb569ea49e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67152024-11-05T00:07:06.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 812 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 5acc0a5a-1b35-4543-99fa-0dd381ccf8cf response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
67162024-11-05T00:07:07.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3e461d55-daf4-4479-b284-663a89abf582 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67172024-11-05T00:07:07.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3e461d55-daf4-4479-b284-663a89abf582 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67182024-11-05T00:07:07.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3e461d55-daf4-4479-b284-663a89abf582 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67192024-11-05T00:07:08.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6435f87-afe0-4305-9bec-207d62b961af roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67202024-11-05T00:07:08.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6435f87-afe0-4305-9bec-207d62b961af resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67212024-11-05T00:07:08.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c6435f87-afe0-4305-9bec-207d62b961af response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67222024-11-05T00:07:09.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = db907987-4789-4e03-8f02-91fd89bbcb7b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67232024-11-05T00:07:09.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = db907987-4789-4e03-8f02-91fd89bbcb7b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67242024-11-05T00:07:09.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = db907987-4789-4e03-8f02-91fd89bbcb7b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67252024-11-05T00:07:10.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 307901e1-afb7-4564-b9b8-85a1bf626157 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67262024-11-05T00:07:10.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 307901e1-afb7-4564-b9b8-85a1bf626157 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67272024-11-05T00:07:10.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 307901e1-afb7-4564-b9b8-85a1bf626157 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67282024-11-05T00:07:11.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f34b3259-914f-47f1-a085-3605635f7ce1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67292024-11-05T00:07:11.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f34b3259-914f-47f1-a085-3605635f7ce1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67302024-11-05T00:07:11.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f34b3259-914f-47f1-a085-3605635f7ce1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
67312024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
67322024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67332024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
67342024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
67352024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67362024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
67372024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67382024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
67392024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
67402024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67412024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
67422024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67432024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67442024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
67452024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67462024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67472024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
67482024-11-05T00:07:12.173ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67492024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67502024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
67512024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67522024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
67532024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67542024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
67552024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67562024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
67572024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67582024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
67592024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.67\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
67602024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
67612024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
67622024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.39\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
67632024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
67642024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.97\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
67652024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.93\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
67662024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67672024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67682024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67692024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67702024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67712024-11-05T00:07:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67722024-11-05T00:07:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67732024-11-05T00:07:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67742024-11-05T00:07:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67752024-11-05T00:07:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67762024-11-05T00:07:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67772024-11-05T00:07:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67782024-11-05T00:07:12.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792024-11-05T00:07:12.176ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67802024-11-05T00:07:12.176ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.359639ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67812024-11-05T00:07:12.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67822024-11-05T00:07:12.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3075, tv_nsec: 762750693 } })
67832024-11-05T00:07:12.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
67842024-11-05T00:07:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67852024-11-05T00:07:12.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67862024-11-05T00:07:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67872024-11-05T00:07:12.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67882024-11-05T00:07:12.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67892024-11-05T00:07:12.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67902024-11-05T00:07:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67912024-11-05T00:07:12.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67922024-11-05T00:07:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67932024-11-05T00:07:12.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67942024-11-05T00:07:12.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67952024-11-05T00:07:12.184ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67962024-11-05T00:07:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67972024-11-05T00:07:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67982024-11-05T00:07:12.185ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67992024-11-05T00:07:12.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68002024-11-05T00:07:12.186ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68012024-11-05T00:07:12.186ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68022024-11-05T00:07:12.186ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68032024-11-05T00:07:12.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
68042024-11-05T00:07:12.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68052024-11-05T00:07:12.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68062024-11-05T00:07:12.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68072024-11-05T00:07:12.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3075, tv_nsec: 773527874 } })
68082024-11-05T00:07:12.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
68092024-11-05T00:07:12.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68102024-11-05T00:07:12.189ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68112024-11-05T00:07:12.189ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.470748ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68122024-11-05T00:07:12.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68132024-11-05T00:07:12.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68142024-11-05T00:07:12.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68152024-11-05T00:07:12.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68162024-11-05T00:07:12.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68172024-11-05T00:07:12.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68182024-11-05T00:07:12.195ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3075, tv_nsec: 780885815 } })
68192024-11-05T00:07:12.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68202024-11-05T00:07:12.195ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
68212024-11-05T00:07:12.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
68222024-11-05T00:07:12.198ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68232024-11-05T00:07:12.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68242024-11-05T00:07:12.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68252024-11-05T00:07:12.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68262024-11-05T00:07:12.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68272024-11-05T00:07:12.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68282024-11-05T00:07:12.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c36336ee-9d62-4c23-b108-332727e3227a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
68292024-11-05T00:07:12.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c36336ee-9d62-4c23-b108-332727e3227a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
68302024-11-05T00:07:12.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68312024-11-05T00:07:12.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68322024-11-05T00:07:12.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c36336ee-9d62-4c23-b108-332727e3227a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
68332024-11-05T00:07:12.238ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68342024-11-05T00:07:12.238ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68352024-11-05T00:07:12.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68362024-11-05T00:07:12.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68372024-11-05T00:07:12.239ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
68382024-11-05T00:07:12.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.584727ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
68392024-11-05T00:07:12.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68402024-11-05T00:07:12.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68412024-11-05T00:07:12.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68422024-11-05T00:07:12.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68432024-11-05T00:07:12.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68442024-11-05T00:07:12.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68452024-11-05T00:07:12.249ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68462024-11-05T00:07:12.249ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.047181ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68472024-11-05T00:07:12.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.276646ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68482024-11-05T00:07:12.265ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
68492024-11-05T00:07:12.265ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68502024-11-05T00:07:12.265ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ada97f5-f244-4554-9f3d-f442000141ed", "content-length": "26", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
68512024-11-05T00:07:12.265ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68522024-11-05T00:07:12.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68532024-11-05T00:07:12.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68542024-11-05T00:07:12.268ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68552024-11-05T00:07:12.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68562024-11-05T00:07:12.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68572024-11-05T00:07:12.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68582024-11-05T00:07:12.273ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68592024-11-05T00:07:12.273ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68602024-11-05T00:07:12.273ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 100.623065ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68612024-11-05T00:07:12.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
68622024-11-05T00:07:12.275ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68632024-11-05T00:07:12.275ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fc34ffe-d800-448c-9d1d-f5f6854fde27", "content-length": "26", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
68642024-11-05T00:07:12.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
68652024-11-05T00:07:12.275ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68662024-11-05T00:07:12.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68672024-11-05T00:07:12.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68682024-11-05T00:07:12.277ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68692024-11-05T00:07:12.277ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.427283ms iteration = 26 status = 0
68702024-11-05T00:07:12.293ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
68712024-11-05T00:07:12.293ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68722024-11-05T00:07:12.293ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0123d434-96c1-43c8-bcac-7f91b5cba699", "content-length": "26", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
68732024-11-05T00:07:12.293ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68742024-11-05T00:07:12.294ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
68752024-11-05T00:07:12.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68762024-11-05T00:07:12.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68772024-11-05T00:07:12.338ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68782024-11-05T00:07:12.338ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68792024-11-05T00:07:12.339ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "27207df7-ca40-43c1-bef8-d74e639ed3e8", "content-length": "372", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
68802024-11-05T00:07:12.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68812024-11-05T00:07:12.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68822024-11-05T00:07:12.343ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 170.784085ms iteration = 26 status = {}
68832024-11-05T00:07:12.349ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68842024-11-05T00:07:12.350ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d889fd2f-0136-48b6-b6f6-c2350f8bfe4f", "content-length": "2", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
68852024-11-05T00:07:12.351ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68862024-11-05T00:07:12.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68872024-11-05T00:07:12.353ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 180.569196ms iteration = 26 status = null
68882024-11-05T00:07:12.354ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.435043ms iteration = 29 status = {"physical_disks_added":0}
68892024-11-05T00:07:12.381ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
68902024-11-05T00:07:12.381ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68912024-11-05T00:07:12.381ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "232f92bc-321f-43e0-b6b1-ed77317866ed", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
68922024-11-05T00:07:12.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68932024-11-05T00:07:12.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68942024-11-05T00:07:12.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68952024-11-05T00:07:12.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68962024-11-05T00:07:12.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68972024-11-05T00:07:12.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68982024-11-05T00:07:12.390ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68992024-11-05T00:07:12.390ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69002024-11-05T00:07:12.391ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7823ded8-ad63-4ee2-bfd3-48674c1c84f4", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
69012024-11-05T00:07:12.392ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 219.401703ms iteration = 27 status = {}
69022024-11-05T00:07:12.406ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69032024-11-05T00:07:12.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69042024-11-05T00:07:12.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69052024-11-05T00:07:12.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69062024-11-05T00:07:12.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69072024-11-05T00:07:12.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69082024-11-05T00:07:12.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69092024-11-05T00:07:12.413ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69102024-11-05T00:07:12.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69112024-11-05T00:07:12.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69122024-11-05T00:07:12.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69132024-11-05T00:07:12.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69142024-11-05T00:07:12.419ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
69152024-11-05T00:07:12.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69162024-11-05T00:07:12.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69172024-11-05T00:07:12.429ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69182024-11-05T00:07:12.430ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "790f42c4-96ed-4079-8670-35d96167cceb", "content-length": "134", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
69192024-11-05T00:07:12.430ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69202024-11-05T00:07:12.430ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
69212024-11-05T00:07:12.430ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69222024-11-05T00:07:12.430ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69232024-11-05T00:07:12.430ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69242024-11-05T00:07:12.430ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69252024-11-05T00:07:12.430ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69262024-11-05T00:07:12.430ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69272024-11-05T00:07:12.430ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69282024-11-05T00:07:12.430ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69292024-11-05T00:07:12.431ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
69302024-11-05T00:07:12.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69312024-11-05T00:07:12.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69322024-11-05T00:07:12.433ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69332024-11-05T00:07:12.433ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f87a2037-af55-497f-a2d3-36fb915df43a", "content-length": "2", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
69342024-11-05T00:07:12.433ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69352024-11-05T00:07:12.433ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "faf77810-fa51-4870-8e20-eada814d2eef", "content-length": "52", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
69362024-11-05T00:07:12.433ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
69372024-11-05T00:07:12.433ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69382024-11-05T00:07:12.451ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69392024-11-05T00:07:12.570ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "26465320-f8e9-4c5d-a229-0ec1078e0efc", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
69402024-11-05T00:07:12.570ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
69412024-11-05T00:07:12.570ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69422024-11-05T00:07:12.571ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "de573d17-5540-4c1b-bc0e-655f0124cf90", "content-length": "682", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
69432024-11-05T00:07:12.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69442024-11-05T00:07:12.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69452024-11-05T00:07:12.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69462024-11-05T00:07:12.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69472024-11-05T00:07:12.577ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "166f6464-84b5-42b0-ae8e-05ea2c3d3af2", "content-length": "691", "date": "Tue, 05 Nov 2024 00:07:12 GMT"} })
69482024-11-05T00:07:12.577ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69492024-11-05T00:07:12.577ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69502024-11-05T00:07:12.577ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69512024-11-05T00:07:12.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69522024-11-05T00:07:12.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69532024-11-05T00:07:12.579ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 406.413142ms iteration = 27 status = {}
69542024-11-05T00:07:12.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69552024-11-05T00:07:12.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69562024-11-05T00:07:12.589ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 416.51332ms iteration = 26 status = {}
69572024-11-05T00:07:13.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d5e340c9-a6e2-4ea9-9c1c-9adf5191cbe8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69582024-11-05T00:07:13.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d5e340c9-a6e2-4ea9-9c1c-9adf5191cbe8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69592024-11-05T00:07:13.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d5e340c9-a6e2-4ea9-9c1c-9adf5191cbe8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69602024-11-05T00:07:14.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c1cabacd-c8ef-4159-b09a-1032ff735198 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69612024-11-05T00:07:14.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c1cabacd-c8ef-4159-b09a-1032ff735198 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69622024-11-05T00:07:14.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c1cabacd-c8ef-4159-b09a-1032ff735198 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69632024-11-05T00:07:15.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cabd0376-c175-45d5-8d55-c860745dfb46 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69642024-11-05T00:07:15.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cabd0376-c175-45d5-8d55-c860745dfb46 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69652024-11-05T00:07:15.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cabd0376-c175-45d5-8d55-c860745dfb46 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69662024-11-05T00:07:16.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c98e40bc-6512-4452-b9b4-34f61e01b998 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69672024-11-05T00:07:16.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c98e40bc-6512-4452-b9b4-34f61e01b998 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69682024-11-05T00:07:16.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c98e40bc-6512-4452-b9b4-34f61e01b998 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69692024-11-05T00:07:17.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 04814f78-b7e1-4779-8432-e2e6e4f5080e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69702024-11-05T00:07:17.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 04814f78-b7e1-4779-8432-e2e6e4f5080e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69712024-11-05T00:07:17.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 04814f78-b7e1-4779-8432-e2e6e4f5080e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69722024-11-05T00:07:18.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 67b7eedd-c0c2-4252-adb5-52ed67cae81d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69732024-11-05T00:07:18.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 67b7eedd-c0c2-4252-adb5-52ed67cae81d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69742024-11-05T00:07:18.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 67b7eedd-c0c2-4252-adb5-52ed67cae81d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69752024-11-05T00:07:19.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e701f7e6-9062-4e1e-853f-422d9135a403 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69762024-11-05T00:07:19.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e701f7e6-9062-4e1e-853f-422d9135a403 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69772024-11-05T00:07:19.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e701f7e6-9062-4e1e-853f-422d9135a403 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69782024-11-05T00:07:20.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f2291482-bd8e-49c4-b9a8-ae70bc9ef43e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69792024-11-05T00:07:20.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f2291482-bd8e-49c4-b9a8-ae70bc9ef43e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69802024-11-05T00:07:20.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f2291482-bd8e-49c4-b9a8-ae70bc9ef43e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69812024-11-05T00:07:21.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1ab381bb-3f29-4448-834b-0193f634e812 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69822024-11-05T00:07:21.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1ab381bb-3f29-4448-834b-0193f634e812 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69832024-11-05T00:07:21.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1ab381bb-3f29-4448-834b-0193f634e812 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
69842024-11-05T00:07:21.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 698 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 53c4ce42-343b-44b7-8ada-171b2b795e9e response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
69852024-11-05T00:07:22.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
69862024-11-05T00:07:22.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
69872024-11-05T00:07:22.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69882024-11-05T00:07:22.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69892024-11-05T00:07:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69902024-11-05T00:07:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69912024-11-05T00:07:22.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69922024-11-05T00:07:22.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69932024-11-05T00:07:22.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69942024-11-05T00:07:22.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69952024-11-05T00:07:22.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69962024-11-05T00:07:22.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69972024-11-05T00:07:22.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69982024-11-05T00:07:22.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
69992024-11-05T00:07:22.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70002024-11-05T00:07:22.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70012024-11-05T00:07:22.195ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
70022024-11-05T00:07:22.195ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.690196ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
70032024-11-05T00:07:22.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70042024-11-05T00:07:22.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70052024-11-05T00:07:22.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.770442ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70062024-11-05T00:07:22.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4dd304a9-58c4-4b63-8a11-cbcbfe3d3eb9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70072024-11-05T00:07:22.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4dd304a9-58c4-4b63-8a11-cbcbfe3d3eb9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70082024-11-05T00:07:22.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4dd304a9-58c4-4b63-8a11-cbcbfe3d3eb9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70092024-11-05T00:07:23.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 489f7101-f129-47b5-b572-313e5638dc26 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70102024-11-05T00:07:23.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 489f7101-f129-47b5-b572-313e5638dc26 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70112024-11-05T00:07:23.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 489f7101-f129-47b5-b572-313e5638dc26 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70122024-11-05T00:07:24.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b784fbc5-5026-4987-9610-c6ca03fe53ee roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70132024-11-05T00:07:24.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b784fbc5-5026-4987-9610-c6ca03fe53ee resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70142024-11-05T00:07:24.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b784fbc5-5026-4987-9610-c6ca03fe53ee response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70152024-11-05T00:07:25.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3364b44b-e1ed-446f-9aff-0674fac8584d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70162024-11-05T00:07:25.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3364b44b-e1ed-446f-9aff-0674fac8584d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70172024-11-05T00:07:25.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 3364b44b-e1ed-446f-9aff-0674fac8584d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70182024-11-05T00:07:26.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9fd91466-2a4f-41f9-a2e9-d75f4a6199e3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70192024-11-05T00:07:26.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9fd91466-2a4f-41f9-a2e9-d75f4a6199e3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70202024-11-05T00:07:26.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9fd91466-2a4f-41f9-a2e9-d75f4a6199e3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70212024-11-05T00:07:26.873ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:62381
70222024-11-05T00:07:26.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = e7fcc126-fae8-43f0-88a3-8a1ce6643af6 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
70232024-11-05T00:07:26.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = e7fcc126-fae8-43f0-88a3-8a1ce6643af6 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
70242024-11-05T00:07:26.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = e7fcc126-fae8-43f0-88a3-8a1ce6643af6 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
70252024-11-05T00:07:26.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 89be8ab5-6a91-4334-a879-0a8c3ff94230 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
70262024-11-05T00:07:26.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 89be8ab5-6a91-4334-a879-0a8c3ff94230 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
70272024-11-05T00:07:26.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 89be8ab5-6a91-4334-a879-0a8c3ff94230 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
70282024-11-05T00:07:27.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f34329e9-5dd5-4a9c-a6b1-894b91a7b642 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70292024-11-05T00:07:27.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f34329e9-5dd5-4a9c-a6b1-894b91a7b642 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70302024-11-05T00:07:27.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f34329e9-5dd5-4a9c-a6b1-894b91a7b642 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70312024-11-05T00:07:28.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b2f2e982-2e7b-478a-a2fe-b6c0a9c17c84 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70322024-11-05T00:07:28.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b2f2e982-2e7b-478a-a2fe-b6c0a9c17c84 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70332024-11-05T00:07:28.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b2f2e982-2e7b-478a-a2fe-b6c0a9c17c84 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70342024-11-05T00:07:29.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58fab66f-1b96-4f25-82b0-571acc838eab roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70352024-11-05T00:07:29.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58fab66f-1b96-4f25-82b0-571acc838eab resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70362024-11-05T00:07:29.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58fab66f-1b96-4f25-82b0-571acc838eab response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70372024-11-05T00:07:30.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 119f4e3c-860f-44db-8633-32489bec0d41 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70382024-11-05T00:07:30.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 119f4e3c-860f-44db-8633-32489bec0d41 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70392024-11-05T00:07:30.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 119f4e3c-860f-44db-8633-32489bec0d41 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70402024-11-05T00:07:31.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 09089cc0-901f-496e-87c9-07ace5cc8d58 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70412024-11-05T00:07:31.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 09089cc0-901f-496e-87c9-07ace5cc8d58 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70422024-11-05T00:07:31.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 09089cc0-901f-496e-87c9-07ace5cc8d58 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70432024-11-05T00:07:32.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
70442024-11-05T00:07:32.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
70452024-11-05T00:07:32.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70462024-11-05T00:07:32.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70472024-11-05T00:07:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70482024-11-05T00:07:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70492024-11-05T00:07:32.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70502024-11-05T00:07:32.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70512024-11-05T00:07:32.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70522024-11-05T00:07:32.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.451702ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70532024-11-05T00:07:32.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70542024-11-05T00:07:32.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70552024-11-05T00:07:32.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70562024-11-05T00:07:32.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70572024-11-05T00:07:32.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70582024-11-05T00:07:32.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70592024-11-05T00:07:32.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
70602024-11-05T00:07:32.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70612024-11-05T00:07:32.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70622024-11-05T00:07:32.194ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
70632024-11-05T00:07:32.194ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.571913ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
70642024-11-05T00:07:32.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4fe81378-a646-45b6-927a-023ee6a6a4f8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70652024-11-05T00:07:32.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4fe81378-a646-45b6-927a-023ee6a6a4f8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70662024-11-05T00:07:32.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4fe81378-a646-45b6-927a-023ee6a6a4f8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70672024-11-05T00:07:33.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 37e36388-375f-4994-aba0-f41d6dddd3f4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70682024-11-05T00:07:33.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 37e36388-375f-4994-aba0-f41d6dddd3f4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70692024-11-05T00:07:33.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 37e36388-375f-4994-aba0-f41d6dddd3f4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70702024-11-05T00:07:34.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c3a28773-0ec8-4c80-b48b-0fe730cbe58e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70712024-11-05T00:07:34.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c3a28773-0ec8-4c80-b48b-0fe730cbe58e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70722024-11-05T00:07:34.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c3a28773-0ec8-4c80-b48b-0fe730cbe58e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70732024-11-05T00:07:35.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 083b724f-4d08-4d35-b608-9d360739d929 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70742024-11-05T00:07:35.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 083b724f-4d08-4d35-b608-9d360739d929 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70752024-11-05T00:07:35.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 083b724f-4d08-4d35-b608-9d360739d929 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70762024-11-05T00:07:36.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7820a92c-9f8d-4376-ae69-4ef24b34a245 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70772024-11-05T00:07:36.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7820a92c-9f8d-4376-ae69-4ef24b34a245 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70782024-11-05T00:07:36.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7820a92c-9f8d-4376-ae69-4ef24b34a245 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70792024-11-05T00:07:36.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 510 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = f29e642d-f0d8-47a9-9511-39d5c99d4d36 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
70802024-11-05T00:07:37.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c72c6a76-5a0c-4f55-81e6-c7ea3d423b0f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70812024-11-05T00:07:37.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c72c6a76-5a0c-4f55-81e6-c7ea3d423b0f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70822024-11-05T00:07:37.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2689 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c72c6a76-5a0c-4f55-81e6-c7ea3d423b0f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70832024-11-05T00:07:38.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 72280eae-5209-4fab-aad3-1934dabc4f62 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70842024-11-05T00:07:38.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 72280eae-5209-4fab-aad3-1934dabc4f62 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70852024-11-05T00:07:38.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 72280eae-5209-4fab-aad3-1934dabc4f62 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70862024-11-05T00:07:39.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 74e0894b-9fe4-4b08-ab03-66a4e144cca0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70872024-11-05T00:07:39.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 74e0894b-9fe4-4b08-ab03-66a4e144cca0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70882024-11-05T00:07:39.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 74e0894b-9fe4-4b08-ab03-66a4e144cca0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70892024-11-05T00:07:40.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 01e11cfa-847a-4703-87b9-31ac970971d4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70902024-11-05T00:07:40.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 01e11cfa-847a-4703-87b9-31ac970971d4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70912024-11-05T00:07:40.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 01e11cfa-847a-4703-87b9-31ac970971d4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70922024-11-05T00:07:41.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 421b2beb-a350-41b7-b20f-436a32e2645b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70932024-11-05T00:07:41.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 421b2beb-a350-41b7-b20f-436a32e2645b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70942024-11-05T00:07:41.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 421b2beb-a350-41b7-b20f-436a32e2645b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
70952024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
70962024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70972024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
70982024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
70992024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71002024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71012024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
71022024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
71032024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
71042024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71052024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71062024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
71072024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71082024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
71092024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
71102024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
71112024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
71122024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
71132024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
71142024-11-05T00:07:42.173ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-04 23:57:42.173462283 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
71152024-11-05T00:07:42.173ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71162024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71172024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
71182024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71192024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
71202024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
71212024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71222024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
71232024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71242024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
71252024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71262024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
71272024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71282024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
71292024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
71302024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71312024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
71322024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
71332024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71342024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71352024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
71362024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
71372024-11-05T00:07:42.173ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970
71382024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71392024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
71402024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.471\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970"}
71412024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
71422024-11-05T00:07:42.173ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
71432024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71442024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71452024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
71462024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.43\u{b5}s iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
71472024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
71482024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
71492024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
71502024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.4\u{b5}s iteration = 27 status = {"errors":[],"records_set_to_done":[]}
71512024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
71522024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
71532024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
71542024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 14.15\u{b5}s iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
71552024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
71562024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.22\u{b5}s iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
71572024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71582024-11-05T00:07:42.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71592024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71602024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71612024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71622024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
71632024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71642024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71652024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71662024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71672024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71682024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71692024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71702024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71712024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71722024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71732024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71742024-11-05T00:07:42.174ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f4c9dd5-dad6-4fc2-ba58-b064adbea295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3105, tv_nsec: 759984556 } })
71752024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71762024-11-05T00:07:42.174ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("08f058bf-bffa-4561-8799-2d5d32641d33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e5a3f00-3f5b-4cac-8aa4-99515a0afee2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3105, tv_nsec: 760040367 } })
71772024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
71782024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
71792024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
71802024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.316387ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
71812024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
71822024-11-05T00:07:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.488191ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
71832024-11-05T00:07:42.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3105, tv_nsec: 761671211 } })
71842024-11-05T00:07:42.176ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
71852024-11-05T00:07:42.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71862024-11-05T00:07:42.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71872024-11-05T00:07:42.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71882024-11-05T00:07:42.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71892024-11-05T00:07:42.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71902024-11-05T00:07:42.178ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.665696ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71912024-11-05T00:07:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71922024-11-05T00:07:42.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71932024-11-05T00:07:42.178ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-04 23:57:42.173462283 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
71942024-11-05T00:07:42.178ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.241118ms iteration = 14 status = {"expiration":"2024-11-04T23:57:42.173462283Z","pruned":[]}
71952024-11-05T00:07:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71962024-11-05T00:07:42.180ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71972024-11-05T00:07:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71982024-11-05T00:07:42.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71992024-11-05T00:07:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72002024-11-05T00:07:42.181ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3105, tv_nsec: 767228385 } })
72012024-11-05T00:07:42.181ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
72022024-11-05T00:07:42.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72032024-11-05T00:07:42.182ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72042024-11-05T00:07:42.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72052024-11-05T00:07:42.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72062024-11-05T00:07:42.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72072024-11-05T00:07:42.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72082024-11-05T00:07:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72092024-11-05T00:07:42.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72102024-11-05T00:07:42.185ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72112024-11-05T00:07:42.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72122024-11-05T00:07:42.186ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72132024-11-05T00:07:42.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72142024-11-05T00:07:42.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72152024-11-05T00:07:42.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72162024-11-05T00:07:42.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
72172024-11-05T00:07:42.188ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72182024-11-05T00:07:42.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72192024-11-05T00:07:42.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72202024-11-05T00:07:42.188ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72212024-11-05T00:07:42.189ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.252583ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
72222024-11-05T00:07:42.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72232024-11-05T00:07:42.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72242024-11-05T00:07:42.194ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72252024-11-05T00:07:42.194ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72262024-11-05T00:07:42.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72272024-11-05T00:07:42.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72282024-11-05T00:07:42.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72292024-11-05T00:07:42.195ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72302024-11-05T00:07:42.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72312024-11-05T00:07:42.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72322024-11-05T00:07:42.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72332024-11-05T00:07:42.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72342024-11-05T00:07:42.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72352024-11-05T00:07:42.230ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72362024-11-05T00:07:42.230ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72372024-11-05T00:07:42.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72382024-11-05T00:07:42.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72392024-11-05T00:07:42.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72402024-11-05T00:07:42.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72412024-11-05T00:07:42.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72422024-11-05T00:07:42.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
72432024-11-05T00:07:42.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72442024-11-05T00:07:42.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72452024-11-05T00:07:42.240ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 67.337932ms iteration = 27 status = 0
72462024-11-05T00:07:42.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72472024-11-05T00:07:42.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72482024-11-05T00:07:42.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72492024-11-05T00:07:42.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72502024-11-05T00:07:42.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72512024-11-05T00:07:42.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72522024-11-05T00:07:42.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.078059ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72532024-11-05T00:07:42.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72542024-11-05T00:07:42.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72552024-11-05T00:07:42.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72562024-11-05T00:07:42.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72572024-11-05T00:07:42.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72582024-11-05T00:07:42.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72592024-11-05T00:07:42.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72602024-11-05T00:07:42.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3105, tv_nsec: 838438086 } })
72612024-11-05T00:07:42.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72622024-11-05T00:07:42.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72632024-11-05T00:07:42.253ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
72642024-11-05T00:07:42.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72652024-11-05T00:07:42.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.710776ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72662024-11-05T00:07:42.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72672024-11-05T00:07:42.255ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
72682024-11-05T00:07:42.255ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
72692024-11-05T00:07:42.255ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 82.141065ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
72702024-11-05T00:07:42.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72712024-11-05T00:07:42.257ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72722024-11-05T00:07:42.257ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.226538ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72732024-11-05T00:07:42.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72742024-11-05T00:07:42.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72752024-11-05T00:07:42.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72762024-11-05T00:07:42.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72772024-11-05T00:07:42.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72782024-11-05T00:07:42.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72792024-11-05T00:07:42.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72802024-11-05T00:07:42.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72812024-11-05T00:07:42.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72822024-11-05T00:07:42.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
72832024-11-05T00:07:42.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72842024-11-05T00:07:42.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72852024-11-05T00:07:42.276ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
72862024-11-05T00:07:42.277ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
72872024-11-05T00:07:42.277ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.228398ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
72882024-11-05T00:07:42.290ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72892024-11-05T00:07:42.291ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72902024-11-05T00:07:42.291ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72912024-11-05T00:07:42.291ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
72922024-11-05T00:07:42.291ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 117.512281ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
72932024-11-05T00:07:42.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72942024-11-05T00:07:42.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72952024-11-05T00:07:42.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72962024-11-05T00:07:42.300ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72972024-11-05T00:07:42.300ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72982024-11-05T00:07:42.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72992024-11-05T00:07:42.303ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73002024-11-05T00:07:42.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73012024-11-05T00:07:42.305ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73022024-11-05T00:07:42.305ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73032024-11-05T00:07:42.305ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73042024-11-05T00:07:42.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73052024-11-05T00:07:42.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73062024-11-05T00:07:42.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73072024-11-05T00:07:42.310ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
73082024-11-05T00:07:42.310ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73092024-11-05T00:07:42.311ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de43970f-fa56-4744-bdc3-3510c59ffdb0", "content-length": "26", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} })
73102024-11-05T00:07:42.311ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73112024-11-05T00:07:42.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73122024-11-05T00:07:42.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73132024-11-05T00:07:42.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73142024-11-05T00:07:42.313ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73152024-11-05T00:07:42.315ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.461343ms iteration = 30 status = {"physical_disks_added":0}
73162024-11-05T00:07:42.315ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
73172024-11-05T00:07:42.315ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
73182024-11-05T00:07:42.315ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
73192024-11-05T00:07:42.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73202024-11-05T00:07:42.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73212024-11-05T00:07:42.321ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
73222024-11-05T00:07:42.321ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73232024-11-05T00:07:42.321ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c00e3b9b-4273-4b4b-9b3a-ee276acc116f", "content-length": "26", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} })
73242024-11-05T00:07:42.321ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73252024-11-05T00:07:42.323ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73262024-11-05T00:07:42.327ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73272024-11-05T00:07:42.327ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73282024-11-05T00:07:42.327ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.911619ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73292024-11-05T00:07:42.345ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
73302024-11-05T00:07:42.345ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 172.501741ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
73312024-11-05T00:07:42.353ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
73322024-11-05T00:07:42.353ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
73332024-11-05T00:07:42.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73342024-11-05T00:07:42.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73352024-11-05T00:07:42.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73362024-11-05T00:07:42.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73372024-11-05T00:07:42.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
73382024-11-05T00:07:42.366ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-04T23:54:39.943212Z, time_modified: 2024-11-04T23:54:39.943212Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }) }
73392024-11-05T00:07:42.366ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 192.91352ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]}},"default_endpoint":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
73402024-11-05T00:07:42.399ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
73412024-11-05T00:07:42.399ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73422024-11-05T00:07:42.399ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d58474cd-b127-49fd-a4ca-e08a33d1a905", "content-length": "26", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} })
73432024-11-05T00:07:42.399ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73442024-11-05T00:07:42.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
73452024-11-05T00:07:42.477ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
73462024-11-05T00:07:42.487ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73472024-11-05T00:07:42.487ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "14ffdca3-d77d-4239-8743-2687f6fd27ac", "content-length": "2", "date": "Tue, 05 Nov 2024 00:07:41 GMT"} })
73482024-11-05T00:07:42.489ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73492024-11-05T00:07:42.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73502024-11-05T00:07:42.520ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73512024-11-05T00:07:42.520ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73522024-11-05T00:07:42.521ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c99e0720-447a-4796-817a-9eb42c0fd0bb", "content-length": "372", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} })
73532024-11-05T00:07:42.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73542024-11-05T00:07:42.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73552024-11-05T00:07:42.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73562024-11-05T00:07:42.524ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73572024-11-05T00:07:42.525ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 352.358663ms iteration = 27 status = null
73582024-11-05T00:07:42.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73592024-11-05T00:07:42.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73602024-11-05T00:07:42.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73612024-11-05T00:07:42.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73622024-11-05T00:07:42.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73632024-11-05T00:07:42.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73642024-11-05T00:07:42.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73652024-11-05T00:07:42.530ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
73662024-11-05T00:07:42.530ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
73672024-11-05T00:07:42.530ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-04 23:54:43.769339 UTC dns_group = internal generation = 1
73682024-11-05T00:07:42.530ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 357.030699ms iteration = 14 status = {"generation":1}
73692024-11-05T00:07:42.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73702024-11-05T00:07:42.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73712024-11-05T00:07:42.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73722024-11-05T00:07:42.554ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
73732024-11-05T00:07:42.554ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d214df21-0508-464b-999b-5b52ca55b12e", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73742024-11-05T00:07:42.554ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73752024-11-05T00:07:42.555ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e631c0c7-d643-41f8-8ed7-515f024142ff", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73762024-11-05T00:07:42.555ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73772024-11-05T00:07:42.557ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73782024-11-05T00:07:42.557ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 384.056754ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
73792024-11-05T00:07:42.565ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
73802024-11-05T00:07:42.565ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 0 version = 2
73812024-11-05T00:07:42.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73822024-11-05T00:07:42.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73832024-11-05T00:07:42.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73842024-11-05T00:07:42.568ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73852024-11-05T00:07:42.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73862024-11-05T00:07:42.570ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73872024-11-05T00:07:42.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73882024-11-05T00:07:42.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73892024-11-05T00:07:42.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73902024-11-05T00:07:42.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73912024-11-05T00:07:42.582ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 1 version = 2
73922024-11-05T00:07:42.582ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
73932024-11-05T00:07:42.582ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-04 23:54:45.073528 UTC dns_group = external generation = 2
73942024-11-05T00:07:42.582ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 408.812702ms iteration = 14 status = {"generation":2}
73952024-11-05T00:07:42.589ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 415.705533ms iteration = 27 status = {}
73962024-11-05T00:07:42.595ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
73972024-11-05T00:07:42.595ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73982024-11-05T00:07:42.596ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0b582f91-1688-4f59-bb50-4d1bf60ca753", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} })
73992024-11-05T00:07:42.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74002024-11-05T00:07:42.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74012024-11-05T00:07:42.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74022024-11-05T00:07:42.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74032024-11-05T00:07:42.623ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
74042024-11-05T00:07:42.624ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "964e8268-6e8d-4e35-b979-38a9c73be467", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74052024-11-05T00:07:42.624ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74062024-11-05T00:07:42.626ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "166b73f0-256e-4dac-a555-64a6e54df5fa", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74072024-11-05T00:07:42.626ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74082024-11-05T00:07:42.628ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6f7613b6-bc39-4b5e-9f37-1a62e4a1dc03", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74092024-11-05T00:07:42.628ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74102024-11-05T00:07:42.630ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74112024-11-05T00:07:42.630ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 457.613704ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
74122024-11-05T00:07:42.655ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74132024-11-05T00:07:42.656ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "adf0100d-b618-4275-92c7-032a27946b84", "content-length": "691", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} })
74142024-11-05T00:07:42.656ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
74152024-11-05T00:07:42.656ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
74162024-11-05T00:07:42.656ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
74172024-11-05T00:07:42.657ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 484.057776ms iteration = 28 status = {}
74182024-11-05T00:07:42.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74192024-11-05T00:07:42.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74202024-11-05T00:07:42.662ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74212024-11-05T00:07:42.662ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74222024-11-05T00:07:42.662ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c9d75583-c643-4e69-a01c-11787977b2a9", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} })
74232024-11-05T00:07:42.664ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 490.881157ms iteration = 28 status = {}
74242024-11-05T00:07:42.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74252024-11-05T00:07:42.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74262024-11-05T00:07:42.699ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
74272024-11-05T00:07:42.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74282024-11-05T00:07:42.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74292024-11-05T00:07:42.709ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74302024-11-05T00:07:42.710ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "346bb789-e548-4961-8f4f-f953583cdd93", "content-length": "134", "date": "Tue, 05 Nov 2024 00:07:41 GMT"} })
74312024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
74322024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
74332024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74342024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74352024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74362024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74372024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74382024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74392024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74402024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74412024-11-05T00:07:42.710ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
74422024-11-05T00:07:42.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74432024-11-05T00:07:42.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74442024-11-05T00:07:42.713ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74452024-11-05T00:07:42.713ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcd52732-3cc4-4378-9987-83d7f82af5cd", "content-length": "2", "date": "Tue, 05 Nov 2024 00:07:41 GMT"} })
74462024-11-05T00:07:42.713ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74472024-11-05T00:07:42.713ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbdf0b22-8dc5-4bef-aba5-089e1043e62e", "content-length": "52", "date": "Tue, 05 Nov 2024 00:07:41 GMT"} })
74482024-11-05T00:07:42.713ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
74492024-11-05T00:07:42.713ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74502024-11-05T00:07:42.934ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "01a6f09d-6d16-4bd4-9c06-d81ee65e3aa1", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} })
74512024-11-05T00:07:42.934ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
74522024-11-05T00:07:42.934ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74532024-11-05T00:07:42.935ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e0b0576-5dcc-486e-a1a1-21aeb6e5ea13", "content-length": "682", "date": "Tue, 05 Nov 2024 00:07:42 GMT"} })
74542024-11-05T00:07:42.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74552024-11-05T00:07:42.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74562024-11-05T00:07:42.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74572024-11-05T00:07:42.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74582024-11-05T00:07:42.942ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74592024-11-05T00:07:42.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74602024-11-05T00:07:42.944ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74612024-11-05T00:07:42.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74622024-11-05T00:07:42.951ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 777.733155ms iteration = 27 status = {}
74632024-11-05T00:07:42.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fa86ea0c-29df-4338-a249-b6863fee01e6 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74642024-11-05T00:07:42.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fa86ea0c-29df-4338-a249-b6863fee01e6 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74652024-11-05T00:07:42.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = fa86ea0c-29df-4338-a249-b6863fee01e6 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74662024-11-05T00:07:44.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6453663f-7cc5-4032-8a4a-fd78ea9ab484 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74672024-11-05T00:07:44.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6453663f-7cc5-4032-8a4a-fd78ea9ab484 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74682024-11-05T00:07:44.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6453663f-7cc5-4032-8a4a-fd78ea9ab484 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74692024-11-05T00:07:45.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c629bdaa-6c7c-4d23-8344-0096c3ba9a20 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74702024-11-05T00:07:45.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c629bdaa-6c7c-4d23-8344-0096c3ba9a20 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74712024-11-05T00:07:45.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c629bdaa-6c7c-4d23-8344-0096c3ba9a20 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74722024-11-05T00:07:46.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9671d117-18b7-4cfe-856f-219c765c56bf roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74732024-11-05T00:07:46.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9671d117-18b7-4cfe-856f-219c765c56bf resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74742024-11-05T00:07:46.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9671d117-18b7-4cfe-856f-219c765c56bf response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74752024-11-05T00:07:47.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5cd6c54a-cd8a-4907-8d69-41c51fd123c2 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74762024-11-05T00:07:47.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5cd6c54a-cd8a-4907-8d69-41c51fd123c2 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74772024-11-05T00:07:47.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5cd6c54a-cd8a-4907-8d69-41c51fd123c2 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74782024-11-05T00:07:48.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7120e5e4-1ef2-4058-9954-e539fb98e3f7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74792024-11-05T00:07:48.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7120e5e4-1ef2-4058-9954-e539fb98e3f7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74802024-11-05T00:07:48.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7120e5e4-1ef2-4058-9954-e539fb98e3f7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74812024-11-05T00:07:49.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac3e5853-5e57-4ebb-9291-340ba28acc39 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74822024-11-05T00:07:49.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac3e5853-5e57-4ebb-9291-340ba28acc39 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74832024-11-05T00:07:49.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ac3e5853-5e57-4ebb-9291-340ba28acc39 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74842024-11-05T00:07:50.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6433fc4b-6f59-49ae-9abf-3e13a530b145 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74852024-11-05T00:07:50.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6433fc4b-6f59-49ae-9abf-3e13a530b145 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74862024-11-05T00:07:50.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6433fc4b-6f59-49ae-9abf-3e13a530b145 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74872024-11-05T00:07:51.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = eb34f924-ed50-44c2-b111-6c3795fbf2fd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74882024-11-05T00:07:51.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = eb34f924-ed50-44c2-b111-6c3795fbf2fd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74892024-11-05T00:07:51.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = eb34f924-ed50-44c2-b111-6c3795fbf2fd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
74902024-11-05T00:07:51.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 765 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 547d749a-914a-4463-b1bb-1681e2db5c00 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
74912024-11-05T00:07:52.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
74922024-11-05T00:07:52.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74932024-11-05T00:07:52.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
74942024-11-05T00:07:52.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74952024-11-05T00:07:52.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74962024-11-05T00:07:52.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74972024-11-05T00:07:52.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74982024-11-05T00:07:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74992024-11-05T00:07:52.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75002024-11-05T00:07:52.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75012024-11-05T00:07:52.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75022024-11-05T00:07:52.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75032024-11-05T00:07:52.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75042024-11-05T00:07:52.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
75052024-11-05T00:07:52.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75062024-11-05T00:07:52.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75072024-11-05T00:07:52.195ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
75082024-11-05T00:07:52.195ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.964641ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
75092024-11-05T00:07:52.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75102024-11-05T00:07:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75112024-11-05T00:07:52.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1bb7a03e-f75d-4e56-8896-920f9ef3bb98 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75122024-11-05T00:07:52.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1bb7a03e-f75d-4e56-8896-920f9ef3bb98 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75132024-11-05T00:07:52.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1bb7a03e-f75d-4e56-8896-920f9ef3bb98 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75142024-11-05T00:07:52.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.98659ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75152024-11-05T00:07:53.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c942bd04-8e9a-46cd-9bc8-d3fb9dd99cbb roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75162024-11-05T00:07:53.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c942bd04-8e9a-46cd-9bc8-d3fb9dd99cbb resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75172024-11-05T00:07:53.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c942bd04-8e9a-46cd-9bc8-d3fb9dd99cbb response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75182024-11-05T00:07:54.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7761136b-9751-4007-a4d6-8ed02de132c7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75192024-11-05T00:07:54.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7761136b-9751-4007-a4d6-8ed02de132c7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75202024-11-05T00:07:54.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7761136b-9751-4007-a4d6-8ed02de132c7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75212024-11-05T00:07:55.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c28ffed7-3b1e-4366-90bc-e7d3b8432c7e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75222024-11-05T00:07:55.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c28ffed7-3b1e-4366-90bc-e7d3b8432c7e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75232024-11-05T00:07:55.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c28ffed7-3b1e-4366-90bc-e7d3b8432c7e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75242024-11-05T00:07:56.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a23a281a-2054-45dc-942a-53f54dff365f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75252024-11-05T00:07:56.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a23a281a-2054-45dc-942a-53f54dff365f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75262024-11-05T00:07:56.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a23a281a-2054-45dc-942a-53f54dff365f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75272024-11-05T00:07:56.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 58688f5f-b846-425b-ab42-5685c3c7ad20 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
75282024-11-05T00:07:56.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 58688f5f-b846-425b-ab42-5685c3c7ad20 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
75292024-11-05T00:07:56.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 58688f5f-b846-425b-ab42-5685c3c7ad20 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
75302024-11-05T00:07:56.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 8ed404dd-9106-4977-850a-7644f9968c93 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
75312024-11-05T00:07:56.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 8ed404dd-9106-4977-850a-7644f9968c93 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
75322024-11-05T00:07:56.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 8ed404dd-9106-4977-850a-7644f9968c93 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
75332024-11-05T00:07:57.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = da272109-21ed-45c6-b030-5e6bddec26c4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75342024-11-05T00:07:57.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = da272109-21ed-45c6-b030-5e6bddec26c4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75352024-11-05T00:07:57.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = da272109-21ed-45c6-b030-5e6bddec26c4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75362024-11-05T00:07:58.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bcbd68e4-8950-4a89-9796-f666f2063c69 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75372024-11-05T00:07:58.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bcbd68e4-8950-4a89-9796-f666f2063c69 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75382024-11-05T00:07:58.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bcbd68e4-8950-4a89-9796-f666f2063c69 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75392024-11-05T00:07:59.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 55d24db8-a9d6-4893-9c84-707c4652f1e0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75402024-11-05T00:07:59.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 55d24db8-a9d6-4893-9c84-707c4652f1e0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75412024-11-05T00:07:59.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 55d24db8-a9d6-4893-9c84-707c4652f1e0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75422024-11-05T00:08:00.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 57a5e1ca-9b38-4ba5-863c-b3eed81891a7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75432024-11-05T00:08:00.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 57a5e1ca-9b38-4ba5-863c-b3eed81891a7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75442024-11-05T00:08:00.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 57a5e1ca-9b38-4ba5-863c-b3eed81891a7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75452024-11-05T00:08:01.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2bab1d78-e634-4f1b-ac6e-4135e7373157 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75462024-11-05T00:08:01.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2bab1d78-e634-4f1b-ac6e-4135e7373157 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75472024-11-05T00:08:01.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2bab1d78-e634-4f1b-ac6e-4135e7373157 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75482024-11-05T00:08:02.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
75492024-11-05T00:08:02.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
75502024-11-05T00:08:02.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75512024-11-05T00:08:02.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75522024-11-05T00:08:02.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75532024-11-05T00:08:02.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75542024-11-05T00:08:02.176ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75552024-11-05T00:08:02.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75562024-11-05T00:08:02.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572024-11-05T00:08:02.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.063363ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75582024-11-05T00:08:02.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75592024-11-05T00:08:02.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75602024-11-05T00:08:02.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75612024-11-05T00:08:02.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75622024-11-05T00:08:02.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75632024-11-05T00:08:02.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75642024-11-05T00:08:02.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
75652024-11-05T00:08:02.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75662024-11-05T00:08:02.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75672024-11-05T00:08:02.225ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
75682024-11-05T00:08:02.225ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.763773ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
75692024-11-05T00:08:02.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6b0d22dd-6a06-4cf7-8dbf-f4b9a34584c0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75702024-11-05T00:08:02.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6b0d22dd-6a06-4cf7-8dbf-f4b9a34584c0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75712024-11-05T00:08:02.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6b0d22dd-6a06-4cf7-8dbf-f4b9a34584c0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75722024-11-05T00:08:03.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 611c9ff7-0c9e-477f-8ce7-59d8ec151449 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75732024-11-05T00:08:03.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 611c9ff7-0c9e-477f-8ce7-59d8ec151449 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75742024-11-05T00:08:03.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 611c9ff7-0c9e-477f-8ce7-59d8ec151449 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75752024-11-05T00:08:04.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9cf69bb0-b7c7-479b-a671-4a89e8636b67 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75762024-11-05T00:08:04.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9cf69bb0-b7c7-479b-a671-4a89e8636b67 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75772024-11-05T00:08:04.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9cf69bb0-b7c7-479b-a671-4a89e8636b67 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75782024-11-05T00:08:05.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 95394f28-5c8a-44e5-b2f6-bb5572a82997 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75792024-11-05T00:08:05.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 95394f28-5c8a-44e5-b2f6-bb5572a82997 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75802024-11-05T00:08:05.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 95394f28-5c8a-44e5-b2f6-bb5572a82997 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75812024-11-05T00:08:06.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = abd41189-c32f-4aa0-a742-e732d7fa3e8e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75822024-11-05T00:08:06.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = abd41189-c32f-4aa0-a742-e732d7fa3e8e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75832024-11-05T00:08:06.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = abd41189-c32f-4aa0-a742-e732d7fa3e8e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75842024-11-05T00:08:06.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 927 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 448844dc-d571-4ce2-b4b6-519f4c60912d response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
75852024-11-05T00:08:07.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f5f92ac3-d3a4-446e-9777-8bbc62688899 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75862024-11-05T00:08:07.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f5f92ac3-d3a4-446e-9777-8bbc62688899 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75872024-11-05T00:08:07.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f5f92ac3-d3a4-446e-9777-8bbc62688899 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75882024-11-05T00:08:08.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 45653c81-edc6-4486-81bf-bb90a8f743dc roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75892024-11-05T00:08:08.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 45653c81-edc6-4486-81bf-bb90a8f743dc resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75902024-11-05T00:08:08.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 45653c81-edc6-4486-81bf-bb90a8f743dc response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75912024-11-05T00:08:09.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5322fe1b-6bed-4ab2-b994-b0121a1b653a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75922024-11-05T00:08:09.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5322fe1b-6bed-4ab2-b994-b0121a1b653a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75932024-11-05T00:08:09.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5322fe1b-6bed-4ab2-b994-b0121a1b653a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75942024-11-05T00:08:10.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 875e175d-bc92-438b-8d0f-9a00a9b5e727 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75952024-11-05T00:08:10.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 875e175d-bc92-438b-8d0f-9a00a9b5e727 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75962024-11-05T00:08:10.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 875e175d-bc92-438b-8d0f-9a00a9b5e727 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75972024-11-05T00:08:11.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d4a5fb34-32ef-4420-835f-4e92863d7ddb roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75982024-11-05T00:08:11.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d4a5fb34-32ef-4420-835f-4e92863d7ddb resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
75992024-11-05T00:08:11.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d4a5fb34-32ef-4420-835f-4e92863d7ddb response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
76002024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
76012024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
76022024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76032024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
76042024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76052024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76062024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76072024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
76082024-11-05T00:08:12.172ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76092024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76102024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
76112024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76122024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
76132024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
76142024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76152024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
76162024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76172024-11-05T00:08:12.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76182024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
76192024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
76202024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
76212024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
76222024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76232024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
76242024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76252024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76262024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76272024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76282024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76292024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76302024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76312024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76322024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76332024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76342024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76352024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76362024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76372024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76382024-11-05T00:08:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76392024-11-05T00:08:12.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
76402024-11-05T00:08:12.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
76412024-11-05T00:08:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.251\u{b5}s iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76422024-11-05T00:08:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.501\u{b5}s iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
76432024-11-05T00:08:12.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
76442024-11-05T00:08:12.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
76452024-11-05T00:08:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.23\u{b5}s iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
76462024-11-05T00:08:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.63\u{b5}s iteration = 28 status = {"errors":[],"records_set_to_done":[]}
76472024-11-05T00:08:12.175ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482024-11-05T00:08:12.176ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76492024-11-05T00:08:12.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3135, tv_nsec: 761707611 } })
76502024-11-05T00:08:12.176ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.696905ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76512024-11-05T00:08:12.176ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
76522024-11-05T00:08:12.177ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3135, tv_nsec: 762672441 } })
76532024-11-05T00:08:12.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
76542024-11-05T00:08:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76552024-11-05T00:08:12.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76562024-11-05T00:08:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76572024-11-05T00:08:12.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76582024-11-05T00:08:12.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76592024-11-05T00:08:12.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76602024-11-05T00:08:12.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76612024-11-05T00:08:12.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76622024-11-05T00:08:12.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76632024-11-05T00:08:12.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76642024-11-05T00:08:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76652024-11-05T00:08:12.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76662024-11-05T00:08:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76672024-11-05T00:08:12.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76682024-11-05T00:08:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76692024-11-05T00:08:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76702024-11-05T00:08:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76712024-11-05T00:08:12.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76722024-11-05T00:08:12.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76732024-11-05T00:08:12.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76742024-11-05T00:08:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76752024-11-05T00:08:12.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76762024-11-05T00:08:12.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76772024-11-05T00:08:12.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76782024-11-05T00:08:12.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76792024-11-05T00:08:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76802024-11-05T00:08:12.188ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3135, tv_nsec: 773608216 } })
76812024-11-05T00:08:12.188ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
76822024-11-05T00:08:12.219ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76832024-11-05T00:08:12.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76842024-11-05T00:08:12.220ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76852024-11-05T00:08:12.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76862024-11-05T00:08:12.223ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76872024-11-05T00:08:12.223ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76882024-11-05T00:08:12.223ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
76892024-11-05T00:08:12.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76902024-11-05T00:08:12.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76912024-11-05T00:08:12.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76922024-11-05T00:08:12.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76932024-11-05T00:08:12.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76942024-11-05T00:08:12.243ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76952024-11-05T00:08:12.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76962024-11-05T00:08:12.243ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.414145ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76972024-11-05T00:08:12.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76982024-11-05T00:08:12.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76992024-11-05T00:08:12.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77002024-11-05T00:08:12.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77012024-11-05T00:08:12.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77022024-11-05T00:08:12.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77032024-11-05T00:08:12.248ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
77042024-11-05T00:08:12.248ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77052024-11-05T00:08:12.249ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "436156c9-cafb-4b4e-9872-db1e279ab16a", "content-length": "26", "date": "Tue, 05 Nov 2024 00:08:12 GMT"} })
77062024-11-05T00:08:12.249ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77072024-11-05T00:08:12.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
77082024-11-05T00:08:12.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77092024-11-05T00:08:12.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77102024-11-05T00:08:12.251ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77112024-11-05T00:08:12.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77122024-11-05T00:08:12.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77132024-11-05T00:08:12.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77142024-11-05T00:08:12.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77152024-11-05T00:08:12.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77162024-11-05T00:08:12.264ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
77172024-11-05T00:08:12.264ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77182024-11-05T00:08:12.264ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e4f4374-28e8-42c5-aee1-8607203a2baf", "content-length": "26", "date": "Tue, 05 Nov 2024 00:08:12 GMT"} })
77192024-11-05T00:08:12.264ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77202024-11-05T00:08:12.266ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
77212024-11-05T00:08:12.266ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77222024-11-05T00:08:12.267ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77232024-11-05T00:08:12.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
77242024-11-05T00:08:12.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77252024-11-05T00:08:12.267ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12cdfe4b-489b-415c-a6cc-da2534986eff", "content-length": "26", "date": "Tue, 05 Nov 2024 00:08:12 GMT"} })
77262024-11-05T00:08:12.267ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77272024-11-05T00:08:12.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77282024-11-05T00:08:12.269ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
77292024-11-05T00:08:12.270ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77302024-11-05T00:08:12.270ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77312024-11-05T00:08:12.270ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77322024-11-05T00:08:12.270ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.208195ms iteration = 28 status = 0
77332024-11-05T00:08:12.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77342024-11-05T00:08:12.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.406931ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77352024-11-05T00:08:12.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.551594ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77362024-11-05T00:08:12.274ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
77372024-11-05T00:08:12.274ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.729457ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
77382024-11-05T00:08:12.298ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 125.588898ms iteration = 31 status = {"physical_disks_added":0}
77392024-11-05T00:08:12.300ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77402024-11-05T00:08:12.300ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77412024-11-05T00:08:12.300ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.022687ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77422024-11-05T00:08:12.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77432024-11-05T00:08:12.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77442024-11-05T00:08:12.333ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 160.652677ms iteration = 28 status = {}
77452024-11-05T00:08:12.360ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77462024-11-05T00:08:12.360ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77472024-11-05T00:08:12.360ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e538d52-c171-4e03-8a7c-ed10da9563fd", "content-length": "372", "date": "Tue, 05 Nov 2024 00:08:12 GMT"} })
77482024-11-05T00:08:12.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77492024-11-05T00:08:12.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77502024-11-05T00:08:12.362ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77512024-11-05T00:08:12.362ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "83ff34f0-b088-43ec-8f78-72037cf0e71c", "content-length": "2", "date": "Tue, 05 Nov 2024 00:08:11 GMT"} })
77522024-11-05T00:08:12.364ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77532024-11-05T00:08:12.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77542024-11-05T00:08:12.366ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 193.683745ms iteration = 28 status = null
77552024-11-05T00:08:12.400ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77562024-11-05T00:08:12.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77572024-11-05T00:08:12.402ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77582024-11-05T00:08:12.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77592024-11-05T00:08:12.404ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77602024-11-05T00:08:12.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77612024-11-05T00:08:12.405ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
77622024-11-05T00:08:12.405ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77632024-11-05T00:08:12.405ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "076a3a3f-e35b-438b-bccb-592b61cbdceb", "date": "Tue, 05 Nov 2024 00:08:12 GMT"} })
77642024-11-05T00:08:12.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77652024-11-05T00:08:12.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77662024-11-05T00:08:12.406ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77672024-11-05T00:08:12.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77682024-11-05T00:08:12.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77692024-11-05T00:08:12.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77702024-11-05T00:08:12.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77712024-11-05T00:08:12.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77722024-11-05T00:08:12.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77732024-11-05T00:08:12.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77742024-11-05T00:08:12.414ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77752024-11-05T00:08:12.415ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77762024-11-05T00:08:12.415ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "81e26b87-b8f1-4f36-8b12-9c6429436143", "date": "Tue, 05 Nov 2024 00:08:12 GMT"} })
77772024-11-05T00:08:12.416ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 243.814045ms iteration = 29 status = {}
77782024-11-05T00:08:12.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77792024-11-05T00:08:12.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77802024-11-05T00:08:12.426ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
77812024-11-05T00:08:12.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77822024-11-05T00:08:12.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77832024-11-05T00:08:12.436ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77842024-11-05T00:08:12.437ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c3a9181-77eb-4766-ba64-9011dcb898d7", "content-length": "134", "date": "Tue, 05 Nov 2024 00:08:11 GMT"} })
77852024-11-05T00:08:12.437ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77862024-11-05T00:08:12.437ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
77872024-11-05T00:08:12.437ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77882024-11-05T00:08:12.437ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77892024-11-05T00:08:12.437ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77902024-11-05T00:08:12.437ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77912024-11-05T00:08:12.437ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77922024-11-05T00:08:12.437ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77932024-11-05T00:08:12.437ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77942024-11-05T00:08:12.437ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77952024-11-05T00:08:12.438ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
77962024-11-05T00:08:12.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77972024-11-05T00:08:12.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77982024-11-05T00:08:12.440ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77992024-11-05T00:08:12.440ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "39c012bb-27a6-4c6b-a3c8-93cc847118c4", "content-length": "2", "date": "Tue, 05 Nov 2024 00:08:11 GMT"} })
78002024-11-05T00:08:12.440ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78012024-11-05T00:08:12.440ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "92e6c9eb-efdd-4a28-a137-3b5f26943e4e", "content-length": "52", "date": "Tue, 05 Nov 2024 00:08:11 GMT"} })
78022024-11-05T00:08:12.440ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
78032024-11-05T00:08:12.440ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78042024-11-05T00:08:12.501ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78052024-11-05T00:08:12.564ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4d960252-511f-469a-8bfc-1d3a8561cf06", "date": "Tue, 05 Nov 2024 00:08:12 GMT"} })
78062024-11-05T00:08:12.564ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
78072024-11-05T00:08:12.564ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78082024-11-05T00:08:12.565ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff45466a-f6e9-4ae9-a55b-a2ec1b71a14a", "content-length": "691", "date": "Tue, 05 Nov 2024 00:08:12 GMT"} })
78092024-11-05T00:08:12.565ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
78102024-11-05T00:08:12.565ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
78112024-11-05T00:08:12.565ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
78122024-11-05T00:08:12.565ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "431ec597-1b42-4d41-b7e9-a2d891c315cf", "content-length": "682", "date": "Tue, 05 Nov 2024 00:08:12 GMT"} })
78132024-11-05T00:08:12.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78142024-11-05T00:08:12.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78152024-11-05T00:08:12.566ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 394.235203ms iteration = 29 status = {}
78162024-11-05T00:08:12.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78172024-11-05T00:08:12.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78182024-11-05T00:08:12.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78192024-11-05T00:08:12.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78202024-11-05T00:08:12.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78212024-11-05T00:08:12.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78222024-11-05T00:08:12.579ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 406.974315ms iteration = 28 status = {}
78232024-11-05T00:08:12.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ca5bf60f-2d9d-4ae2-bfd1-7498cd33af05 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78242024-11-05T00:08:12.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ca5bf60f-2d9d-4ae2-bfd1-7498cd33af05 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78252024-11-05T00:08:12.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ca5bf60f-2d9d-4ae2-bfd1-7498cd33af05 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78262024-11-05T00:08:12.962ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
78272024-11-05T00:08:12.962ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
78282024-11-05T00:08:12.993ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
78292024-11-05T00:08:12.993ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:33900
78302024-11-05T00:08:12.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33900 req_id = bc10f896-9d2d-4298-a9ae-924a2ff7727a roles = RoleSet { roles: {} } uri = /metrics/producers
78312024-11-05T00:08:12.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33900 req_id = bc10f896-9d2d-4298-a9ae-924a2ff7727a resource = Database result = Ok(()) uri = /metrics/producers
78322024-11-05T00:08:13.032ZINFOnexus: assigned collector to new producer collector_id = 936f0bc7-d5c8-4edc-b21c-cc06e01960a5 file = nexus/src/app/oximeter.rs:76 producer_id = 96aa1415-4c39-4ede-a09d-b8326a8455f7
78332024-11-05T00:08:13.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39751 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33900 req_id = bc10f896-9d2d-4298-a9ae-924a2ff7727a response_code = 201 uri = /metrics/producers
78342024-11-05T00:08:13.033ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bc10f896-9d2d-4298-a9ae-924a2ff7727a", "content-length": "41", "date": "Tue, 05 Nov 2024 00:08:12 GMT"} })
78352024-11-05T00:08:13.034ZDEBGnexus (producer-registration-task): registered with nexus successfully
78362024-11-05T00:08:13.034ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
78372024-11-05T00:08:13.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9223fe95-8e58-4d0d-9ac5-faee237c3f70 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78382024-11-05T00:08:13.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9223fe95-8e58-4d0d-9ac5-faee237c3f70 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78392024-11-05T00:08:13.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9223fe95-8e58-4d0d-9ac5-faee237c3f70 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78402024-11-05T00:08:14.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5eb462d5-f804-42e7-8b06-c1d11604eab0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78412024-11-05T00:08:14.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5eb462d5-f804-42e7-8b06-c1d11604eab0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78422024-11-05T00:08:14.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5eb462d5-f804-42e7-8b06-c1d11604eab0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78432024-11-05T00:08:15.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9ea7c96a-1e3b-4e71-8d29-8aa867a44cb5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78442024-11-05T00:08:15.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9ea7c96a-1e3b-4e71-8d29-8aa867a44cb5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78452024-11-05T00:08:15.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9ea7c96a-1e3b-4e71-8d29-8aa867a44cb5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78462024-11-05T00:08:16.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 647ab3dc-4c22-4cc8-baff-7f2d662bdab3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78472024-11-05T00:08:16.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 647ab3dc-4c22-4cc8-baff-7f2d662bdab3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78482024-11-05T00:08:16.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 647ab3dc-4c22-4cc8-baff-7f2d662bdab3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78492024-11-05T00:08:17.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a7fe6e81-bb72-460c-afc6-40d19dc490f1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78502024-11-05T00:08:17.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a7fe6e81-bb72-460c-afc6-40d19dc490f1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78512024-11-05T00:08:17.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a7fe6e81-bb72-460c-afc6-40d19dc490f1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78522024-11-05T00:08:18.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0c039394-3c02-4ae2-8d90-48d4cb0c6fd4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78532024-11-05T00:08:18.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0c039394-3c02-4ae2-8d90-48d4cb0c6fd4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78542024-11-05T00:08:18.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0c039394-3c02-4ae2-8d90-48d4cb0c6fd4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78552024-11-05T00:08:19.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d0543df7-57c5-4e31-97f4-5f3cb0a5cb24 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78562024-11-05T00:08:19.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d0543df7-57c5-4e31-97f4-5f3cb0a5cb24 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78572024-11-05T00:08:19.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d0543df7-57c5-4e31-97f4-5f3cb0a5cb24 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78582024-11-05T00:08:20.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4feadbcf-7465-471b-9fac-0faa79f7b070 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78592024-11-05T00:08:20.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4feadbcf-7465-471b-9fac-0faa79f7b070 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78602024-11-05T00:08:20.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4feadbcf-7465-471b-9fac-0faa79f7b070 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78612024-11-05T00:08:21.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 620 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 75d1bc50-f81f-408d-8069-92d3783d30fc response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
78622024-11-05T00:08:21.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e13eac87-02dd-4729-890e-2f37a4d56831 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78632024-11-05T00:08:21.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e13eac87-02dd-4729-890e-2f37a4d56831 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78642024-11-05T00:08:21.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e13eac87-02dd-4729-890e-2f37a4d56831 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78652024-11-05T00:08:22.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
78662024-11-05T00:08:22.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
78672024-11-05T00:08:22.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78682024-11-05T00:08:22.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78692024-11-05T00:08:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78702024-11-05T00:08:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78712024-11-05T00:08:22.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78722024-11-05T00:08:22.176ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78732024-11-05T00:08:22.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78742024-11-05T00:08:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78752024-11-05T00:08:22.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78762024-11-05T00:08:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78772024-11-05T00:08:22.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78782024-11-05T00:08:22.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78792024-11-05T00:08:22.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78802024-11-05T00:08:22.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
78812024-11-05T00:08:22.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78822024-11-05T00:08:22.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78832024-11-05T00:08:22.196ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
78842024-11-05T00:08:22.196ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.164265ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
78852024-11-05T00:08:22.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.66554ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78862024-11-05T00:08:22.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 62657e27-e34f-4a2a-9adb-0c47fc2cf292 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78872024-11-05T00:08:22.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 62657e27-e34f-4a2a-9adb-0c47fc2cf292 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78882024-11-05T00:08:22.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 62657e27-e34f-4a2a-9adb-0c47fc2cf292 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78892024-11-05T00:08:23.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 02a6ab5d-cda7-4e62-ac5c-37d4a6750a75 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78902024-11-05T00:08:23.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 02a6ab5d-cda7-4e62-ac5c-37d4a6750a75 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78912024-11-05T00:08:23.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 02a6ab5d-cda7-4e62-ac5c-37d4a6750a75 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78922024-11-05T00:08:24.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c03654da-07b5-4fbd-8211-43c030cb8a9f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78932024-11-05T00:08:25.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c03654da-07b5-4fbd-8211-43c030cb8a9f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78942024-11-05T00:08:25.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c03654da-07b5-4fbd-8211-43c030cb8a9f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78952024-11-05T00:08:26.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fe72592-f2ce-4eff-abbd-1fb7e59f6d16 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78962024-11-05T00:08:26.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fe72592-f2ce-4eff-abbd-1fb7e59f6d16 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78972024-11-05T00:08:26.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fe72592-f2ce-4eff-abbd-1fb7e59f6d16 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
78982024-11-05T00:08:26.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 8d6b6c30-09ef-438f-b176-aeb05870c2f9 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
78992024-11-05T00:08:26.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 8d6b6c30-09ef-438f-b176-aeb05870c2f9 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
79002024-11-05T00:08:26.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 8d6b6c30-09ef-438f-b176-aeb05870c2f9 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
79012024-11-05T00:08:26.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = d32ed19c-4198-42cb-b69d-8402fc60f975 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
79022024-11-05T00:08:26.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = d32ed19c-4198-42cb-b69d-8402fc60f975 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
79032024-11-05T00:08:26.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = d32ed19c-4198-42cb-b69d-8402fc60f975 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
79042024-11-05T00:08:27.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6363597d-dda6-4129-8f67-d2e8ae9a2463 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79052024-11-05T00:08:27.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6363597d-dda6-4129-8f67-d2e8ae9a2463 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79062024-11-05T00:08:27.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6363597d-dda6-4129-8f67-d2e8ae9a2463 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79072024-11-05T00:08:28.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 034ca60b-148c-40e6-9e76-29d63b23c243 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79082024-11-05T00:08:28.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 034ca60b-148c-40e6-9e76-29d63b23c243 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79092024-11-05T00:08:28.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 034ca60b-148c-40e6-9e76-29d63b23c243 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79102024-11-05T00:08:29.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e27f42bb-913d-401d-82a7-a0b9e064b610 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79112024-11-05T00:08:29.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e27f42bb-913d-401d-82a7-a0b9e064b610 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79122024-11-05T00:08:29.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e27f42bb-913d-401d-82a7-a0b9e064b610 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79132024-11-05T00:08:30.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 50495e2e-6baf-4798-bc52-0d37d98f947a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79142024-11-05T00:08:30.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 50495e2e-6baf-4798-bc52-0d37d98f947a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79152024-11-05T00:08:30.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 50495e2e-6baf-4798-bc52-0d37d98f947a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79162024-11-05T00:08:31.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d9259d61-ce9c-45f0-82b3-c03020eb2de8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79172024-11-05T00:08:31.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d9259d61-ce9c-45f0-82b3-c03020eb2de8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79182024-11-05T00:08:31.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d9259d61-ce9c-45f0-82b3-c03020eb2de8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79192024-11-05T00:08:32.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dfedaed2-641b-4f28-9390-7b8f8eaae469 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79202024-11-05T00:08:32.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dfedaed2-641b-4f28-9390-7b8f8eaae469 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79212024-11-05T00:08:32.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dfedaed2-641b-4f28-9390-7b8f8eaae469 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79222024-11-05T00:08:32.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
79232024-11-05T00:08:32.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
79242024-11-05T00:08:32.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79252024-11-05T00:08:32.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79262024-11-05T00:08:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79272024-11-05T00:08:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79282024-11-05T00:08:32.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79292024-11-05T00:08:32.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79302024-11-05T00:08:32.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79312024-11-05T00:08:32.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79322024-11-05T00:08:32.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79332024-11-05T00:08:32.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79342024-11-05T00:08:32.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79352024-11-05T00:08:32.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79362024-11-05T00:08:32.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79372024-11-05T00:08:32.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
79382024-11-05T00:08:32.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79392024-11-05T00:08:32.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79402024-11-05T00:08:32.197ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
79412024-11-05T00:08:32.197ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.516574ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
79422024-11-05T00:08:32.205ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.827783ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79432024-11-05T00:08:33.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b11a8adb-dbc0-4f3b-b434-6f3c11e90f25 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79442024-11-05T00:08:33.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b11a8adb-dbc0-4f3b-b434-6f3c11e90f25 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79452024-11-05T00:08:33.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b11a8adb-dbc0-4f3b-b434-6f3c11e90f25 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79462024-11-05T00:08:34.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9f9ff2b3-1f1a-4d9e-8705-664d86bd63c5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79472024-11-05T00:08:34.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9f9ff2b3-1f1a-4d9e-8705-664d86bd63c5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79482024-11-05T00:08:34.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9f9ff2b3-1f1a-4d9e-8705-664d86bd63c5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79492024-11-05T00:08:35.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b645a8ac-de80-4c3b-8b56-c7f4b5b978b4 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79502024-11-05T00:08:35.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b645a8ac-de80-4c3b-8b56-c7f4b5b978b4 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79512024-11-05T00:08:35.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b645a8ac-de80-4c3b-8b56-c7f4b5b978b4 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79522024-11-05T00:08:36.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ede07a98-65eb-4bc9-9473-67b13162ab4f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79532024-11-05T00:08:36.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ede07a98-65eb-4bc9-9473-67b13162ab4f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79542024-11-05T00:08:36.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ede07a98-65eb-4bc9-9473-67b13162ab4f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79552024-11-05T00:08:36.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 877 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 9e2144d1-d7fb-4a8f-a16e-eace40be77d4 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
79562024-11-05T00:08:37.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0c1e9a85-41f1-4817-9e15-44c46e706e2d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79572024-11-05T00:08:37.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0c1e9a85-41f1-4817-9e15-44c46e706e2d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79582024-11-05T00:08:37.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0c1e9a85-41f1-4817-9e15-44c46e706e2d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79592024-11-05T00:08:38.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8126db72-3b34-46c9-bc26-cdd322b7e78b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79602024-11-05T00:08:38.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8126db72-3b34-46c9-bc26-cdd322b7e78b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79612024-11-05T00:08:38.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 8126db72-3b34-46c9-bc26-cdd322b7e78b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79622024-11-05T00:08:39.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 25885f93-c995-4c36-8cba-613c3df7b603 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79632024-11-05T00:08:39.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 25885f93-c995-4c36-8cba-613c3df7b603 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79642024-11-05T00:08:39.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 25885f93-c995-4c36-8cba-613c3df7b603 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79652024-11-05T00:08:40.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 33ccce89-daba-4070-9e70-12c7e37c8653 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79662024-11-05T00:08:40.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 33ccce89-daba-4070-9e70-12c7e37c8653 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79672024-11-05T00:08:40.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 33ccce89-daba-4070-9e70-12c7e37c8653 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79682024-11-05T00:08:41.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ed57d61b-b0d3-4991-a7a9-0b69fe76367a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79692024-11-05T00:08:41.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ed57d61b-b0d3-4991-a7a9-0b69fe76367a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79702024-11-05T00:08:41.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ed57d61b-b0d3-4991-a7a9-0b69fe76367a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
79712024-11-05T00:08:41.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = f330a44c-3c19-43e6-b538-d065c66061ad roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
79722024-11-05T00:08:41.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = f330a44c-3c19-43e6-b538-d065c66061ad resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
79732024-11-05T00:08:41.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = f330a44c-3c19-43e6-b538-d065c66061ad response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
79742024-11-05T00:08:41.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 843f6c4f-14dd-4c0e-83d2-c8d4cb87e368 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
79752024-11-05T00:08:41.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 843f6c4f-14dd-4c0e-83d2-c8d4cb87e368 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
79762024-11-05T00:08:41.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 843f6c4f-14dd-4c0e-83d2-c8d4cb87e368 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
79772024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
79782024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
79792024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79802024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
79812024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79822024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
79832024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
79842024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79852024-11-05T00:08:42.173ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-04 23:58:42.173845212 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
79862024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
79872024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
79882024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.2\u{b5}s iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
79892024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
79902024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
79912024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.249\u{b5}s iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
79922024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
79932024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
79942024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
79952024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.56\u{b5}s iteration = 29 status = {"errors":[],"records_set_to_done":[]}
79962024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79972024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
79982024-11-05T00:08:42.173ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
79992024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
80002024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.83\u{b5}s iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
80012024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
80022024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
80032024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
80042024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80052024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
80062024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
80072024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
80082024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80092024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
80102024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80112024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
80122024-11-05T00:08:42.174ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80132024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
80142024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80152024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
80162024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80172024-11-05T00:08:42.174ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970
80182024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.97\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970"}
80192024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
80202024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80212024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
80222024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
80232024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
80242024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
80252024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80262024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
80272024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80282024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80292024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80302024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
80312024-11-05T00:08:42.174ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
80322024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
80332024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80342024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
80352024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80362024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80372024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80382024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
80392024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80402024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80412024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80422024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
80432024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
80442024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80452024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80462024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80472024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
80482024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80492024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80502024-11-05T00:08:42.174ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f4c9dd5-dad6-4fc2-ba58-b064adbea295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3165, tv_nsec: 759763561 } })
80512024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80522024-11-05T00:08:42.174ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("08f058bf-bffa-4561-8799-2d5d32641d33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e5a3f00-3f5b-4cac-8aa4-99515a0afee2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3165, tv_nsec: 759769981 } })
80532024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80542024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80552024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80562024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80572024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80582024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80592024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80602024-11-05T00:08:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80612024-11-05T00:08:42.175ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
80622024-11-05T00:08:42.175ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.020081ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
80632024-11-05T00:08:42.175ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
80642024-11-05T00:08:42.175ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.252326ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
80652024-11-05T00:08:42.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80662024-11-05T00:08:42.177ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.072344ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80672024-11-05T00:08:42.177ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-04 23:58:42.173845212 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
80682024-11-05T00:08:42.177ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.128724ms iteration = 15 status = {"expiration":"2024-11-04T23:58:42.173845212Z","pruned":[]}
80692024-11-05T00:08:42.177ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3165, tv_nsec: 763155111 } })
80702024-11-05T00:08:42.178ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
80712024-11-05T00:08:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80722024-11-05T00:08:42.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80732024-11-05T00:08:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80742024-11-05T00:08:42.178ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80752024-11-05T00:08:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80762024-11-05T00:08:42.180ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
80772024-11-05T00:08:42.180ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
80782024-11-05T00:08:42.180ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.181297ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
80792024-11-05T00:08:42.180ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80802024-11-05T00:08:42.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80812024-11-05T00:08:42.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80822024-11-05T00:08:42.181ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.023844ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
80832024-11-05T00:08:42.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
80842024-11-05T00:08:42.183ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80852024-11-05T00:08:42.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80862024-11-05T00:08:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80872024-11-05T00:08:42.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80882024-11-05T00:08:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80892024-11-05T00:08:42.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80902024-11-05T00:08:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80912024-11-05T00:08:42.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80922024-11-05T00:08:42.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80932024-11-05T00:08:42.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80942024-11-05T00:08:42.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3165, tv_nsec: 772367810 } })
80952024-11-05T00:08:42.187ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80962024-11-05T00:08:42.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
80972024-11-05T00:08:42.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80982024-11-05T00:08:42.188ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80992024-11-05T00:08:42.188ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81002024-11-05T00:08:42.188ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81012024-11-05T00:08:42.188ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81022024-11-05T00:08:42.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81032024-11-05T00:08:42.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
81042024-11-05T00:08:42.190ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81052024-11-05T00:08:42.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81062024-11-05T00:08:42.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81072024-11-05T00:08:42.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81082024-11-05T00:08:42.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81092024-11-05T00:08:42.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81102024-11-05T00:08:42.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81112024-11-05T00:08:42.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81122024-11-05T00:08:42.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81132024-11-05T00:08:42.195ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81142024-11-05T00:08:42.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81152024-11-05T00:08:42.195ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81162024-11-05T00:08:42.196ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3165, tv_nsec: 782032118 } })
81172024-11-05T00:08:42.197ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
81182024-11-05T00:08:42.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81192024-11-05T00:08:42.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81202024-11-05T00:08:42.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81212024-11-05T00:08:42.200ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81222024-11-05T00:08:42.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81232024-11-05T00:08:42.202ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
81242024-11-05T00:08:42.202ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
81252024-11-05T00:08:42.202ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
81262024-11-05T00:08:42.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81272024-11-05T00:08:42.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81282024-11-05T00:08:42.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81292024-11-05T00:08:42.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81302024-11-05T00:08:42.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81312024-11-05T00:08:42.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81322024-11-05T00:08:42.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81332024-11-05T00:08:42.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81342024-11-05T00:08:42.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81352024-11-05T00:08:42.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81362024-11-05T00:08:42.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81372024-11-05T00:08:42.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81382024-11-05T00:08:42.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
81392024-11-05T00:08:42.221ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81402024-11-05T00:08:42.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81412024-11-05T00:08:42.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81422024-11-05T00:08:42.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
81432024-11-05T00:08:42.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81442024-11-05T00:08:42.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81452024-11-05T00:08:42.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81462024-11-05T00:08:42.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81472024-11-05T00:08:42.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81482024-11-05T00:08:42.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81492024-11-05T00:08:42.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81502024-11-05T00:08:42.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81512024-11-05T00:08:42.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81522024-11-05T00:08:42.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81532024-11-05T00:08:42.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81542024-11-05T00:08:42.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81552024-11-05T00:08:42.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81562024-11-05T00:08:42.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81572024-11-05T00:08:42.253ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
81582024-11-05T00:08:42.253ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
81592024-11-05T00:08:42.253ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
81602024-11-05T00:08:42.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81612024-11-05T00:08:42.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81622024-11-05T00:08:42.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81632024-11-05T00:08:42.255ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81642024-11-05T00:08:42.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
81652024-11-05T00:08:42.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.289729ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
81662024-11-05T00:08:42.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81672024-11-05T00:08:42.257ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
81682024-11-05T00:08:42.257ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
81692024-11-05T00:08:42.257ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.911112ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
81702024-11-05T00:08:42.257ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 82.947232ms iteration = 32 status = {"physical_disks_added":0}
81712024-11-05T00:08:42.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81722024-11-05T00:08:42.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81732024-11-05T00:08:42.258ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81742024-11-05T00:08:42.258ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.833101ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81752024-11-05T00:08:42.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81762024-11-05T00:08:42.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81772024-11-05T00:08:42.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81782024-11-05T00:08:42.262ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.153539ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81792024-11-05T00:08:42.264ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81802024-11-05T00:08:42.264ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81812024-11-05T00:08:42.264ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81822024-11-05T00:08:42.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81832024-11-05T00:08:42.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81842024-11-05T00:08:42.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81852024-11-05T00:08:42.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81862024-11-05T00:08:42.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81872024-11-05T00:08:42.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81882024-11-05T00:08:42.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81892024-11-05T00:08:42.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81902024-11-05T00:08:42.273ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
81912024-11-05T00:08:42.273ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
81922024-11-05T00:08:42.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81932024-11-05T00:08:42.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81942024-11-05T00:08:42.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
81952024-11-05T00:08:42.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81962024-11-05T00:08:42.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81972024-11-05T00:08:42.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81982024-11-05T00:08:42.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81992024-11-05T00:08:42.277ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.062135ms iteration = 29 status = 0
82002024-11-05T00:08:42.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82012024-11-05T00:08:42.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82022024-11-05T00:08:42.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82032024-11-05T00:08:42.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82042024-11-05T00:08:42.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82052024-11-05T00:08:42.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82062024-11-05T00:08:42.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82072024-11-05T00:08:42.281ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
82082024-11-05T00:08:42.281ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
82092024-11-05T00:08:42.281ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-04 23:54:43.769339 UTC dns_group = internal generation = 1
82102024-11-05T00:08:42.281ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 107.850453ms iteration = 15 status = {"generation":1}
82112024-11-05T00:08:42.282ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82122024-11-05T00:08:42.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82132024-11-05T00:08:42.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82142024-11-05T00:08:42.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82152024-11-05T00:08:42.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82162024-11-05T00:08:42.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.637954ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82172024-11-05T00:08:42.293ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82182024-11-05T00:08:42.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82192024-11-05T00:08:42.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82202024-11-05T00:08:42.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82212024-11-05T00:08:42.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82222024-11-05T00:08:42.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82232024-11-05T00:08:42.304ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
82242024-11-05T00:08:42.304ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 0 version = 2
82252024-11-05T00:08:42.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82262024-11-05T00:08:42.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82272024-11-05T00:08:42.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82282024-11-05T00:08:42.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82292024-11-05T00:08:42.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82302024-11-05T00:08:42.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82312024-11-05T00:08:42.316ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 1 version = 2
82322024-11-05T00:08:42.316ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
82332024-11-05T00:08:42.316ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-04 23:54:45.073528 UTC dns_group = external generation = 2
82342024-11-05T00:08:42.316ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 142.150718ms iteration = 15 status = {"generation":2}
82352024-11-05T00:08:42.317ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82362024-11-05T00:08:42.317ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
82372024-11-05T00:08:42.317ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.089347ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
82382024-11-05T00:08:42.342ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-04T23:54:39.943212Z, time_modified: 2024-11-04T23:54:39.943212Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }) }
82392024-11-05T00:08:42.342ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 168.59856ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]}},"default_endpoint":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
82402024-11-05T00:08:42.359ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
82412024-11-05T00:08:42.359ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 185.529679ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
82422024-11-05T00:08:42.365ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
82432024-11-05T00:08:42.385ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
82442024-11-05T00:08:42.385ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82452024-11-05T00:08:42.385ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4572580-853a-484a-a8e2-95daee6d4fe0", "content-length": "26", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
82462024-11-05T00:08:42.385ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82472024-11-05T00:08:42.388ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82482024-11-05T00:08:42.399ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
82492024-11-05T00:08:42.399ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82502024-11-05T00:08:42.399ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a86cfe2-ca08-42d8-bb9c-2dc941da0467", "content-length": "26", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
82512024-11-05T00:08:42.399ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82522024-11-05T00:08:42.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82532024-11-05T00:08:42.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4c390459-8617-4e65-8172-a41a03cab3eb roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
82542024-11-05T00:08:42.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4c390459-8617-4e65-8172-a41a03cab3eb resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
82552024-11-05T00:08:42.528ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
82562024-11-05T00:08:42.528ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82572024-11-05T00:08:42.529ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e8aa392-5577-4aaa-afc0-959bda61ec17", "content-length": "26", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
82582024-11-05T00:08:42.529ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82592024-11-05T00:08:42.531ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
82602024-11-05T00:08:42.531ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
82612024-11-05T00:08:42.548ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
82622024-11-05T00:08:42.548ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82632024-11-05T00:08:42.549ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1643776b-915d-4d72-90c8-198c8d3663ac", "content-length": "372", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
82642024-11-05T00:08:42.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82652024-11-05T00:08:42.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82662024-11-05T00:08:42.598ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 424.391111ms iteration = 29 status = {}
82672024-11-05T00:08:42.610ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
82682024-11-05T00:08:42.611ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a12d6ff-a82d-4281-8cf4-afa011eccc1c", "content-length": "2", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
82692024-11-05T00:08:42.611ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
82702024-11-05T00:08:42.612ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82712024-11-05T00:08:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82722024-11-05T00:08:42.663ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82732024-11-05T00:08:42.664ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1618d0c7-fa49-40e0-b986-9a8666873f36", "content-length": "691", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
82742024-11-05T00:08:42.664ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
82752024-11-05T00:08:42.664ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
82762024-11-05T00:08:42.664ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
82772024-11-05T00:08:42.665ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 491.885597ms iteration = 30 status = {}
82782024-11-05T00:08:42.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 247207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4c390459-8617-4e65-8172-a41a03cab3eb response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
82792024-11-05T00:08:42.666ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 493.123062ms iteration = 29 status = null
82802024-11-05T00:08:42.703ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
82812024-11-05T00:08:42.703ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "172af845-217e-4acd-b3d4-3b4f1dfd6f79", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82822024-11-05T00:08:42.704ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82832024-11-05T00:08:42.706ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c62fa959-51fb-4597-bc96-20789e99ac18", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82842024-11-05T00:08:42.706ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82852024-11-05T00:08:42.708ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3913d663-7ace-43fe-b46c-43558083b35b", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82862024-11-05T00:08:42.708ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82872024-11-05T00:08:42.709ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
82882024-11-05T00:08:42.709ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
82892024-11-05T00:08:42.709ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "38de407e-3bf5-4ea8-8cc8-3ba5eb26ace4", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
82902024-11-05T00:08:42.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82912024-11-05T00:08:42.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82922024-11-05T00:08:42.710ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82932024-11-05T00:08:42.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 536.826719ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
82942024-11-05T00:08:42.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82952024-11-05T00:08:42.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82962024-11-05T00:08:42.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82972024-11-05T00:08:42.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82982024-11-05T00:08:42.716ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
82992024-11-05T00:08:42.717ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "19904675-17fa-430b-a110-15a49b2581dc", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83002024-11-05T00:08:42.717ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83012024-11-05T00:08:42.721ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83022024-11-05T00:08:42.721ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83032024-11-05T00:08:42.721ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d752e853-a6aa-4f52-95a8-d1291d288035", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83042024-11-05T00:08:42.721ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83052024-11-05T00:08:42.721ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "446254e8-b18b-4ca5-afc1-d787f3d9a6cb", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
83062024-11-05T00:08:42.723ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 549.812516ms iteration = 30 status = {}
83072024-11-05T00:08:42.724ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83082024-11-05T00:08:42.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 550.344178ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
83092024-11-05T00:08:42.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83102024-11-05T00:08:42.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83112024-11-05T00:08:42.765ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
83122024-11-05T00:08:42.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83132024-11-05T00:08:42.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83142024-11-05T00:08:42.776ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
83152024-11-05T00:08:42.776ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b87e89d-b061-4e7d-a459-3667c5afb606", "content-length": "134", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
83162024-11-05T00:08:42.776ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
83172024-11-05T00:08:42.776ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
83182024-11-05T00:08:42.776ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
83192024-11-05T00:08:42.776ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83202024-11-05T00:08:42.776ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83212024-11-05T00:08:42.776ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83222024-11-05T00:08:42.776ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83232024-11-05T00:08:42.776ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83242024-11-05T00:08:42.776ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83252024-11-05T00:08:42.776ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83262024-11-05T00:08:42.777ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
83272024-11-05T00:08:42.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83282024-11-05T00:08:42.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83292024-11-05T00:08:42.779ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83302024-11-05T00:08:42.779ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a718644-0f24-4428-919b-af4f9c7f9dad", "content-length": "2", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
83312024-11-05T00:08:42.779ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83322024-11-05T00:08:42.779ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "91d0e000-857d-4348-b4c5-353c86deb28f", "content-length": "52", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
83332024-11-05T00:08:42.779ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
83342024-11-05T00:08:42.779ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83352024-11-05T00:08:42.963ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0cd4e849-c75d-4a18-a658-9faedac99e40", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
83362024-11-05T00:08:42.963ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
83372024-11-05T00:08:42.963ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83382024-11-05T00:08:42.963ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f64a26a0-e579-4180-b449-1c2f8b2676c5", "content-length": "682", "date": "Tue, 05 Nov 2024 00:08:42 GMT"} })
83392024-11-05T00:08:42.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83402024-11-05T00:08:42.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83412024-11-05T00:08:42.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83422024-11-05T00:08:42.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83432024-11-05T00:08:42.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83442024-11-05T00:08:42.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83452024-11-05T00:08:42.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83462024-11-05T00:08:42.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83472024-11-05T00:08:42.980ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 806.586777ms iteration = 29 status = {}
83482024-11-05T00:08:43.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b32af68b-c98d-4a3f-b8b5-06ee93ef9d62 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83492024-11-05T00:08:43.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b32af68b-c98d-4a3f-b8b5-06ee93ef9d62 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83502024-11-05T00:08:43.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b32af68b-c98d-4a3f-b8b5-06ee93ef9d62 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83512024-11-05T00:08:44.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 872fc1fe-19b6-41bd-84e5-0d0ade951e94 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83522024-11-05T00:08:44.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 872fc1fe-19b6-41bd-84e5-0d0ade951e94 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83532024-11-05T00:08:44.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 872fc1fe-19b6-41bd-84e5-0d0ade951e94 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83542024-11-05T00:08:45.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 533a6288-9c33-4f6b-ae54-8e6ab205e242 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83552024-11-05T00:08:45.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 533a6288-9c33-4f6b-ae54-8e6ab205e242 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83562024-11-05T00:08:45.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 533a6288-9c33-4f6b-ae54-8e6ab205e242 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83572024-11-05T00:08:46.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 209b217c-eb0c-47df-abb7-3ff563ee9068 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83582024-11-05T00:08:46.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 209b217c-eb0c-47df-abb7-3ff563ee9068 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83592024-11-05T00:08:46.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 209b217c-eb0c-47df-abb7-3ff563ee9068 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83602024-11-05T00:08:47.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 90bba98b-eae3-4b28-b3c9-374d8c5acec9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83612024-11-05T00:08:47.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 90bba98b-eae3-4b28-b3c9-374d8c5acec9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83622024-11-05T00:08:47.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 90bba98b-eae3-4b28-b3c9-374d8c5acec9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83632024-11-05T00:08:48.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d9803c46-e62b-4a4b-8574-a447893c22c3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83642024-11-05T00:08:48.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d9803c46-e62b-4a4b-8574-a447893c22c3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83652024-11-05T00:08:48.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d9803c46-e62b-4a4b-8574-a447893c22c3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83662024-11-05T00:08:49.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5a83eb71-8b4c-4637-a2c7-5095df2526be roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83672024-11-05T00:08:49.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5a83eb71-8b4c-4637-a2c7-5095df2526be resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83682024-11-05T00:08:49.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5a83eb71-8b4c-4637-a2c7-5095df2526be response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83692024-11-05T00:08:50.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dbf0d911-d2d8-445f-9bb2-c92d25c847e1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83702024-11-05T00:08:50.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dbf0d911-d2d8-445f-9bb2-c92d25c847e1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83712024-11-05T00:08:50.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dbf0d911-d2d8-445f-9bb2-c92d25c847e1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83722024-11-05T00:08:51.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 878 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 0628971a-b75a-43ff-9a38-5c027186d2ee response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
83732024-11-05T00:08:51.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f7e9aa63-7fcb-42c1-8ef7-f63318dcea74 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83742024-11-05T00:08:51.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f7e9aa63-7fcb-42c1-8ef7-f63318dcea74 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83752024-11-05T00:08:51.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f7e9aa63-7fcb-42c1-8ef7-f63318dcea74 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83762024-11-05T00:08:52.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
83772024-11-05T00:08:52.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83782024-11-05T00:08:52.174ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
83792024-11-05T00:08:52.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83802024-11-05T00:08:52.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83812024-11-05T00:08:52.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83822024-11-05T00:08:52.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83832024-11-05T00:08:52.177ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83842024-11-05T00:08:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83852024-11-05T00:08:52.178ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.056073ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83862024-11-05T00:08:52.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83872024-11-05T00:08:52.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83882024-11-05T00:08:52.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83892024-11-05T00:08:52.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83902024-11-05T00:08:52.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83912024-11-05T00:08:52.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83922024-11-05T00:08:52.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
83932024-11-05T00:08:52.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83942024-11-05T00:08:52.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83952024-11-05T00:08:52.193ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
83962024-11-05T00:08:52.194ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.087373ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
83972024-11-05T00:08:52.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fcfbc44-8812-4855-b7f4-e9088ccdf383 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83982024-11-05T00:08:52.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fcfbc44-8812-4855-b7f4-e9088ccdf383 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
83992024-11-05T00:08:52.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6fcfbc44-8812-4855-b7f4-e9088ccdf383 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84002024-11-05T00:08:53.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 19e36c64-6e3b-440a-bc89-c971a649b9e7 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84012024-11-05T00:08:53.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 19e36c64-6e3b-440a-bc89-c971a649b9e7 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84022024-11-05T00:08:53.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 19e36c64-6e3b-440a-bc89-c971a649b9e7 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84032024-11-05T00:08:54.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ab29d5e3-4622-42e7-afdc-f8298321f413 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84042024-11-05T00:08:54.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ab29d5e3-4622-42e7-afdc-f8298321f413 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84052024-11-05T00:08:54.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ab29d5e3-4622-42e7-afdc-f8298321f413 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84062024-11-05T00:08:55.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d96fe3cc-2010-4782-9e9b-26a60b19c759 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84072024-11-05T00:08:55.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d96fe3cc-2010-4782-9e9b-26a60b19c759 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84082024-11-05T00:08:55.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d96fe3cc-2010-4782-9e9b-26a60b19c759 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84092024-11-05T00:08:57.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2205a28-1332-4422-a808-27ed5589771b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84102024-11-05T00:08:57.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2205a28-1332-4422-a808-27ed5589771b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84112024-11-05T00:08:57.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = e2205a28-1332-4422-a808-27ed5589771b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84122024-11-05T00:08:58.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ca53580a-d562-4f9f-8314-e87c1d148492 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84132024-11-05T00:08:58.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ca53580a-d562-4f9f-8314-e87c1d148492 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84142024-11-05T00:08:58.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ca53580a-d562-4f9f-8314-e87c1d148492 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84152024-11-05T00:08:59.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a91b83e4-da2a-4b2e-ac61-451f56fc763e roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84162024-11-05T00:08:59.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a91b83e4-da2a-4b2e-ac61-451f56fc763e resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84172024-11-05T00:08:59.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a91b83e4-da2a-4b2e-ac61-451f56fc763e response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84182024-11-05T00:09:00.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2a0e701e-58a2-4895-88f1-1ddda42cbcf0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84192024-11-05T00:09:00.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2a0e701e-58a2-4895-88f1-1ddda42cbcf0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84202024-11-05T00:09:00.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 2a0e701e-58a2-4895-88f1-1ddda42cbcf0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84212024-11-05T00:09:01.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b7933f35-1b79-4b5f-8c83-76f1ca0c2c60 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84222024-11-05T00:09:01.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b7933f35-1b79-4b5f-8c83-76f1ca0c2c60 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84232024-11-05T00:09:01.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b7933f35-1b79-4b5f-8c83-76f1ca0c2c60 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84242024-11-05T00:09:02.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b03051d4-45ac-4268-b970-d6f652dbc8ce roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84252024-11-05T00:09:02.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b03051d4-45ac-4268-b970-d6f652dbc8ce resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84262024-11-05T00:09:02.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = b03051d4-45ac-4268-b970-d6f652dbc8ce response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84272024-11-05T00:09:02.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
84282024-11-05T00:09:02.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
84292024-11-05T00:09:02.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84302024-11-05T00:09:02.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84312024-11-05T00:09:02.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84322024-11-05T00:09:02.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84332024-11-05T00:09:02.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84342024-11-05T00:09:02.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84352024-11-05T00:09:02.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84362024-11-05T00:09:02.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.225946ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84372024-11-05T00:09:02.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84382024-11-05T00:09:02.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84392024-11-05T00:09:02.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84402024-11-05T00:09:02.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84412024-11-05T00:09:02.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84422024-11-05T00:09:02.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84432024-11-05T00:09:02.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
84442024-11-05T00:09:02.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84452024-11-05T00:09:02.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84462024-11-05T00:09:02.192ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
84472024-11-05T00:09:02.192ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.50099ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
84482024-11-05T00:09:03.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 841c8af1-e7cf-41d4-823f-b5a45632d2c1 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84492024-11-05T00:09:03.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 841c8af1-e7cf-41d4-823f-b5a45632d2c1 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84502024-11-05T00:09:03.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 841c8af1-e7cf-41d4-823f-b5a45632d2c1 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84512024-11-05T00:09:04.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 38457467-08e7-43c4-a8b6-b8d78c94ef58 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84522024-11-05T00:09:04.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 38457467-08e7-43c4-a8b6-b8d78c94ef58 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84532024-11-05T00:09:04.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 38457467-08e7-43c4-a8b6-b8d78c94ef58 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84542024-11-05T00:09:05.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dd9437b8-2657-4247-b891-389f21b0112f roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84552024-11-05T00:09:05.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dd9437b8-2657-4247-b891-389f21b0112f resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84562024-11-05T00:09:05.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dd9437b8-2657-4247-b891-389f21b0112f response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84572024-11-05T00:09:06.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = deb36296-7767-4047-a9db-6dca19c0f09c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84582024-11-05T00:09:06.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = deb36296-7767-4047-a9db-6dca19c0f09c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84592024-11-05T00:09:06.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = deb36296-7767-4047-a9db-6dca19c0f09c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84602024-11-05T00:09:06.882ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 494 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 7c332aa8-5385-4c47-b53b-31991b134bfd response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
84612024-11-05T00:09:07.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 873798e8-649e-4ad7-ade5-c3cb599349ad roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84622024-11-05T00:09:07.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 873798e8-649e-4ad7-ade5-c3cb599349ad resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84632024-11-05T00:09:07.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 873798e8-649e-4ad7-ade5-c3cb599349ad response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84642024-11-05T00:09:08.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 57c1155e-e1c9-446b-8a26-b17c27267335 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84652024-11-05T00:09:08.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 57c1155e-e1c9-446b-8a26-b17c27267335 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84662024-11-05T00:09:08.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 57c1155e-e1c9-446b-8a26-b17c27267335 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84672024-11-05T00:09:09.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5b1e6886-2c11-4b0a-8570-def5e95978d9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84682024-11-05T00:09:09.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5b1e6886-2c11-4b0a-8570-def5e95978d9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84692024-11-05T00:09:09.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5b1e6886-2c11-4b0a-8570-def5e95978d9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84702024-11-05T00:09:10.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9ec5d828-e544-4dfa-9c4e-29ce34d4ee67 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84712024-11-05T00:09:10.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9ec5d828-e544-4dfa-9c4e-29ce34d4ee67 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84722024-11-05T00:09:10.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9ec5d828-e544-4dfa-9c4e-29ce34d4ee67 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84732024-11-05T00:09:11.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bbf08248-4f07-49ab-9f9e-b28728390976 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84742024-11-05T00:09:11.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bbf08248-4f07-49ab-9f9e-b28728390976 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84752024-11-05T00:09:11.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = bbf08248-4f07-49ab-9f9e-b28728390976 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
84762024-11-05T00:09:11.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 86cc74f0-33db-45f0-8ee2-cb74515484a4 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
84772024-11-05T00:09:11.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 86cc74f0-33db-45f0-8ee2-cb74515484a4 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
84782024-11-05T00:09:11.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 86cc74f0-33db-45f0-8ee2-cb74515484a4 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?sort_by=id_ascending
84792024-11-05T00:09:11.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 86176541-2f43-4966-83a0-50ed052e8e52 roles = RoleSet { roles: {} } uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
84802024-11-05T00:09:11.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 86176541-2f43-4966-83a0-50ed052e8e52 resource = Database result = Ok(()) uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
84812024-11-05T00:09:11.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62381 req_id = 86176541-2f43-4966-83a0-50ed052e8e52 response_code = 200 uri = /metrics/collectors/936f0bc7-d5c8-4edc-b21c-cc06e01960a5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGNiZTU4NC1hZTRkLTRiY2QtODg4Ny00MTk5YWFhY2VlMDMifX0%3D
84822024-11-05T00:09:12.173ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
84832024-11-05T00:09:12.173ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84842024-11-05T00:09:12.173ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
84852024-11-05T00:09:12.173ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
84862024-11-05T00:09:12.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84872024-11-05T00:09:12.173ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
84882024-11-05T00:09:12.173ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
84892024-11-05T00:09:12.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
84902024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84912024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84922024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84932024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
84942024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84952024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84962024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
84972024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84982024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
84992024-11-05T00:09:12.174ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85002024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
85012024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85022024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85032024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
85042024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85052024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
85062024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85072024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
85082024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85092024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
85102024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.88\u{b5}s iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
85112024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
85122024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
85132024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.68\u{b5}s iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
85142024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 15.091\u{b5}s iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
85152024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
85162024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.24\u{b5}s iteration = 30 status = {"errors":[],"records_set_to_done":[]}
85172024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85182024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85192024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85202024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85212024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85222024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85232024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85242024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85252024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85262024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85272024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85282024-11-05T00:09:12.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85292024-11-05T00:09:12.177ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3195, tv_nsec: 762164001 } })
85302024-11-05T00:09:12.177ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.579504ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85312024-11-05T00:09:12.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
85322024-11-05T00:09:12.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85332024-11-05T00:09:12.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85342024-11-05T00:09:12.178ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3195, tv_nsec: 763870726 } })
85352024-11-05T00:09:12.179ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
85362024-11-05T00:09:12.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85372024-11-05T00:09:12.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85382024-11-05T00:09:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85392024-11-05T00:09:12.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85402024-11-05T00:09:12.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85412024-11-05T00:09:12.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85422024-11-05T00:09:12.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85432024-11-05T00:09:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85442024-11-05T00:09:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85452024-11-05T00:09:12.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85462024-11-05T00:09:12.182ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85472024-11-05T00:09:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85482024-11-05T00:09:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85492024-11-05T00:09:12.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85502024-11-05T00:09:12.182ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85512024-11-05T00:09:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85522024-11-05T00:09:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85532024-11-05T00:09:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85542024-11-05T00:09:12.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85552024-11-05T00:09:12.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85562024-11-05T00:09:12.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85572024-11-05T00:09:12.185ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85582024-11-05T00:09:12.185ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85592024-11-05T00:09:12.185ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85602024-11-05T00:09:12.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85612024-11-05T00:09:12.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85622024-11-05T00:09:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85632024-11-05T00:09:12.185ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85642024-11-05T00:09:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85652024-11-05T00:09:12.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85662024-11-05T00:09:12.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85672024-11-05T00:09:12.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85682024-11-05T00:09:12.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3195, tv_nsec: 771956092 } })
85692024-11-05T00:09:12.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85702024-11-05T00:09:12.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85712024-11-05T00:09:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85722024-11-05T00:09:12.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
85732024-11-05T00:09:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85742024-11-05T00:09:12.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85752024-11-05T00:09:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85762024-11-05T00:09:12.190ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85772024-11-05T00:09:12.191ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85782024-11-05T00:09:12.191ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85792024-11-05T00:09:12.191ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85802024-11-05T00:09:12.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85812024-11-05T00:09:12.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85822024-11-05T00:09:12.192ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85832024-11-05T00:09:12.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85842024-11-05T00:09:12.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85852024-11-05T00:09:12.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85862024-11-05T00:09:12.194ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85872024-11-05T00:09:12.194ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85882024-11-05T00:09:12.194ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.684864ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85892024-11-05T00:09:12.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
85902024-11-05T00:09:12.197ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85912024-11-05T00:09:12.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85922024-11-05T00:09:12.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85932024-11-05T00:09:12.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85942024-11-05T00:09:12.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85952024-11-05T00:09:12.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85962024-11-05T00:09:12.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85972024-11-05T00:09:12.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85982024-11-05T00:09:12.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85992024-11-05T00:09:12.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86002024-11-05T00:09:12.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86012024-11-05T00:09:12.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86022024-11-05T00:09:12.220ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
86032024-11-05T00:09:12.220ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.651578ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
86042024-11-05T00:09:12.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86052024-11-05T00:09:12.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86062024-11-05T00:09:12.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.237403ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86072024-11-05T00:09:12.228ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86082024-11-05T00:09:12.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86092024-11-05T00:09:12.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86102024-11-05T00:09:12.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86112024-11-05T00:09:12.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86122024-11-05T00:09:12.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
86132024-11-05T00:09:12.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86142024-11-05T00:09:12.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86152024-11-05T00:09:12.236ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.961762ms iteration = 30 status = 0
86162024-11-05T00:09:12.238ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.825971ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86172024-11-05T00:09:12.243ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86182024-11-05T00:09:12.243ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86192024-11-05T00:09:12.243ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 69.128569ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86202024-11-05T00:09:12.247ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 73.994149ms iteration = 33 status = {"physical_disks_added":0}
86212024-11-05T00:09:12.263ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
86222024-11-05T00:09:12.263ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86232024-11-05T00:09:12.263ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "64e26005-7442-43cd-9e62-de104587ae64", "content-length": "26", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86242024-11-05T00:09:12.263ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86252024-11-05T00:09:12.264ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86262024-11-05T00:09:12.270ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
86272024-11-05T00:09:12.270ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86282024-11-05T00:09:12.270ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a6877db-bb33-4ab6-93ac-423a8acabe4a", "content-length": "26", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86292024-11-05T00:09:12.270ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86302024-11-05T00:09:12.272ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
86312024-11-05T00:09:12.273ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
86322024-11-05T00:09:12.273ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86332024-11-05T00:09:12.273ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6189a18-4fbb-4ab7-a65a-626f2586f79b", "content-length": "26", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86342024-11-05T00:09:12.273ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86352024-11-05T00:09:12.275ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86362024-11-05T00:09:12.378ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86372024-11-05T00:09:12.378ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5964bdd3-f341-41ed-bb78-ccddd063c979", "content-length": "2", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86382024-11-05T00:09:12.380ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86392024-11-05T00:09:12.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86402024-11-05T00:09:12.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = af3fe1c0-a66a-4439-87ea-11b47695d0e2 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
86412024-11-05T00:09:12.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = af3fe1c0-a66a-4439-87ea-11b47695d0e2 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
86422024-11-05T00:09:12.393ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 219.591047ms iteration = 30 status = {}
86432024-11-05T00:09:12.468ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86442024-11-05T00:09:12.468ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86452024-11-05T00:09:12.468ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "75da4576-722f-4fbc-8445-e8901a89e9ed", "content-length": "372", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86462024-11-05T00:09:12.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86472024-11-05T00:09:12.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86482024-11-05T00:09:12.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = af3fe1c0-a66a-4439-87ea-11b47695d0e2 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
86492024-11-05T00:09:12.471ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 297.282313ms iteration = 30 status = null
86502024-11-05T00:09:12.493ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86512024-11-05T00:09:12.493ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "15818171-6e90-49c9-a986-af20d78b6e7a", "content-length": "691", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86522024-11-05T00:09:12.493ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
86532024-11-05T00:09:12.493ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
86542024-11-05T00:09:12.493ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
86552024-11-05T00:09:12.495ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 321.800535ms iteration = 31 status = {}
86562024-11-05T00:09:12.495ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
86572024-11-05T00:09:12.495ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86582024-11-05T00:09:12.496ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9d725709-b472-4eaa-ad57-32f86d114d6e", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86592024-11-05T00:09:12.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86602024-11-05T00:09:12.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86612024-11-05T00:09:12.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86622024-11-05T00:09:12.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86632024-11-05T00:09:12.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86642024-11-05T00:09:12.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86652024-11-05T00:09:12.513ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
86662024-11-05T00:09:12.513ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86672024-11-05T00:09:12.513ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ab452a59-e913-4781-8622-74f9f6b7ff19", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86682024-11-05T00:09:12.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86692024-11-05T00:09:12.515ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 341.554831ms iteration = 31 status = {}
86702024-11-05T00:09:12.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86712024-11-05T00:09:12.518ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
86722024-11-05T00:09:12.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86732024-11-05T00:09:12.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86742024-11-05T00:09:12.527ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
86752024-11-05T00:09:12.528ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "25168ea5-e6f0-4252-8636-9470b077cc0d", "content-length": "134", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86762024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
86772024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
86782024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
86792024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86802024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86812024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86822024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86832024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86842024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86852024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86862024-11-05T00:09:12.528ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
86872024-11-05T00:09:12.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86882024-11-05T00:09:12.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86892024-11-05T00:09:12.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86902024-11-05T00:09:12.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9053d042-a205-43ab-b0cd-87774fe000de", "content-length": "2", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86912024-11-05T00:09:12.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86922024-11-05T00:09:12.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a46a4351-7021-482f-8f58-3e88f96c20ce", "content-length": "52", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86932024-11-05T00:09:12.531ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
86942024-11-05T00:09:12.531ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86952024-11-05T00:09:12.668ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "611b47af-8a00-4d4d-b881-ae2b857560f6", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86962024-11-05T00:09:12.668ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
86972024-11-05T00:09:12.668ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86982024-11-05T00:09:12.668ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1011d990-2209-480f-bf2c-d3c071eb5c37", "content-length": "682", "date": "Tue, 05 Nov 2024 00:09:12 GMT"} })
86992024-11-05T00:09:12.668ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87002024-11-05T00:09:12.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87012024-11-05T00:09:12.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87022024-11-05T00:09:12.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87032024-11-05T00:09:12.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87042024-11-05T00:09:12.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87052024-11-05T00:09:12.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87062024-11-05T00:09:12.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87072024-11-05T00:09:12.689ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 515.479302ms iteration = 30 status = {}
87082024-11-05T00:09:13.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dd7ca516-d2d4-4e7b-93b3-bf4b96c8197c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87092024-11-05T00:09:13.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dd7ca516-d2d4-4e7b-93b3-bf4b96c8197c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87102024-11-05T00:09:13.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = dd7ca516-d2d4-4e7b-93b3-bf4b96c8197c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87112024-11-05T00:09:14.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 98b8dc2e-7662-4455-8324-310f0b1f7c26 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87122024-11-05T00:09:14.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 98b8dc2e-7662-4455-8324-310f0b1f7c26 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87132024-11-05T00:09:14.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 98b8dc2e-7662-4455-8324-310f0b1f7c26 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87142024-11-05T00:09:15.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0e48a9c5-3aa1-4369-8d11-2cb907568e7d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87152024-11-05T00:09:15.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0e48a9c5-3aa1-4369-8d11-2cb907568e7d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87162024-11-05T00:09:15.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 0e48a9c5-3aa1-4369-8d11-2cb907568e7d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87172024-11-05T00:09:16.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a77e8596-4c6f-4e58-b8c8-99462d5afe6a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87182024-11-05T00:09:16.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a77e8596-4c6f-4e58-b8c8-99462d5afe6a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87192024-11-05T00:09:16.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = a77e8596-4c6f-4e58-b8c8-99462d5afe6a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87202024-11-05T00:09:17.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 52fcff4a-ed24-4635-be1e-1068f3fe3e7c roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87212024-11-05T00:09:17.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 52fcff4a-ed24-4635-be1e-1068f3fe3e7c resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87222024-11-05T00:09:17.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 52fcff4a-ed24-4635-be1e-1068f3fe3e7c response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87232024-11-05T00:09:18.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c36f0e2f-64ba-4d6f-99c6-41b7cb6f8da9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87242024-11-05T00:09:18.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c36f0e2f-64ba-4d6f-99c6-41b7cb6f8da9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87252024-11-05T00:09:18.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c36f0e2f-64ba-4d6f-99c6-41b7cb6f8da9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87262024-11-05T00:09:19.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 05dc8d6b-37eb-4958-bc18-54838accddb5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87272024-11-05T00:09:19.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 05dc8d6b-37eb-4958-bc18-54838accddb5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87282024-11-05T00:09:19.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 05dc8d6b-37eb-4958-bc18-54838accddb5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87292024-11-05T00:09:20.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c042dc5f-0f2e-41e6-a5e9-b37cc90b0f5b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87302024-11-05T00:09:20.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c042dc5f-0f2e-41e6-a5e9-b37cc90b0f5b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87312024-11-05T00:09:20.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c042dc5f-0f2e-41e6-a5e9-b37cc90b0f5b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87322024-11-05T00:09:21.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9793b642-48f1-4598-b722-2e9d51598a00 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87332024-11-05T00:09:21.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9793b642-48f1-4598-b722-2e9d51598a00 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87342024-11-05T00:09:21.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 9793b642-48f1-4598-b722-2e9d51598a00 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87352024-11-05T00:09:21.883ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 674 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = 0bebec40-159c-48bd-8f9c-6f5bb9d2d7b2 response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
87362024-11-05T00:09:22.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
87372024-11-05T00:09:22.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87382024-11-05T00:09:22.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
87392024-11-05T00:09:22.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87402024-11-05T00:09:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87412024-11-05T00:09:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87422024-11-05T00:09:22.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87432024-11-05T00:09:22.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87442024-11-05T00:09:22.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87452024-11-05T00:09:22.178ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.747448ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87462024-11-05T00:09:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87472024-11-05T00:09:22.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87482024-11-05T00:09:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87492024-11-05T00:09:22.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87502024-11-05T00:09:22.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87512024-11-05T00:09:22.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87522024-11-05T00:09:22.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
87532024-11-05T00:09:22.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87542024-11-05T00:09:22.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87552024-11-05T00:09:22.197ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
87562024-11-05T00:09:22.197ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.178736ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
87572024-11-05T00:09:22.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6bc2aeab-d86f-4f54-a64e-ff1a1df9fae2 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87582024-11-05T00:09:22.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6bc2aeab-d86f-4f54-a64e-ff1a1df9fae2 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87592024-11-05T00:09:22.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 6bc2aeab-d86f-4f54-a64e-ff1a1df9fae2 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87602024-11-05T00:09:23.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cf1b8a39-da17-4478-9b75-a50d18394393 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87612024-11-05T00:09:23.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cf1b8a39-da17-4478-9b75-a50d18394393 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87622024-11-05T00:09:23.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = cf1b8a39-da17-4478-9b75-a50d18394393 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87632024-11-05T00:09:24.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 36acf338-2b56-4ade-8c10-cd13c3b5a5c9 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87642024-11-05T00:09:24.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 36acf338-2b56-4ade-8c10-cd13c3b5a5c9 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87652024-11-05T00:09:24.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 36acf338-2b56-4ade-8c10-cd13c3b5a5c9 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87662024-11-05T00:09:25.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58431539-6351-4671-b934-20bbc7c11d30 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87672024-11-05T00:09:25.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58431539-6351-4671-b934-20bbc7c11d30 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87682024-11-05T00:09:25.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58431539-6351-4671-b934-20bbc7c11d30 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87692024-11-05T00:09:26.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 699abaf3-9eea-4239-961c-18c309d361d6 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87702024-11-05T00:09:26.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 699abaf3-9eea-4239-961c-18c309d361d6 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87712024-11-05T00:09:26.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 699abaf3-9eea-4239-961c-18c309d361d6 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87722024-11-05T00:09:27.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 935e5e58-094b-4fe9-a15d-60a7adf9fec3 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87732024-11-05T00:09:27.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 935e5e58-094b-4fe9-a15d-60a7adf9fec3 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87742024-11-05T00:09:27.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 935e5e58-094b-4fe9-a15d-60a7adf9fec3 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87752024-11-05T00:09:28.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5ca02546-dcba-42ae-9b05-366e315cd2e5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87762024-11-05T00:09:28.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5ca02546-dcba-42ae-9b05-366e315cd2e5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87772024-11-05T00:09:28.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 5ca02546-dcba-42ae-9b05-366e315cd2e5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87782024-11-05T00:09:29.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c054cab6-7fd3-43eb-a548-7d56acf7334a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87792024-11-05T00:09:29.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c054cab6-7fd3-43eb-a548-7d56acf7334a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87802024-11-05T00:09:29.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c054cab6-7fd3-43eb-a548-7d56acf7334a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87812024-11-05T00:09:30.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d50938cf-b109-410f-b068-c283e77828d0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87822024-11-05T00:09:30.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d50938cf-b109-410f-b068-c283e77828d0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87832024-11-05T00:09:30.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d50938cf-b109-410f-b068-c283e77828d0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87842024-11-05T00:09:31.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 779d7b20-0ba4-4e75-a0a2-a59873e8e0a0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87852024-11-05T00:09:31.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 779d7b20-0ba4-4e75-a0a2-a59873e8e0a0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87862024-11-05T00:09:31.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 779d7b20-0ba4-4e75-a0a2-a59873e8e0a0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
87872024-11-05T00:09:32.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
87882024-11-05T00:09:32.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87892024-11-05T00:09:32.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
87902024-11-05T00:09:32.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87912024-11-05T00:09:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87922024-11-05T00:09:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87932024-11-05T00:09:32.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87942024-11-05T00:09:32.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87952024-11-05T00:09:32.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87962024-11-05T00:09:32.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.426721ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87972024-11-05T00:09:32.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87982024-11-05T00:09:32.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87992024-11-05T00:09:32.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88002024-11-05T00:09:32.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88012024-11-05T00:09:32.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88022024-11-05T00:09:32.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88032024-11-05T00:09:32.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
88042024-11-05T00:09:32.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88052024-11-05T00:09:32.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88062024-11-05T00:09:32.193ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
88072024-11-05T00:09:32.193ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.638513ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
88082024-11-05T00:09:32.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f211fad7-fcd5-4112-9f36-394f7760f0dc roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88092024-11-05T00:09:32.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f211fad7-fcd5-4112-9f36-394f7760f0dc resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88102024-11-05T00:09:32.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = f211fad7-fcd5-4112-9f36-394f7760f0dc response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88112024-11-05T00:09:34.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c73dbb4c-3edf-4cdb-a50f-8744b37ee4d8 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88122024-11-05T00:09:34.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c73dbb4c-3edf-4cdb-a50f-8744b37ee4d8 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88132024-11-05T00:09:34.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = c73dbb4c-3edf-4cdb-a50f-8744b37ee4d8 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88142024-11-05T00:09:35.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d7b198dc-e733-4bca-b939-33af3c5f926d roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88152024-11-05T00:09:35.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d7b198dc-e733-4bca-b939-33af3c5f926d resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88162024-11-05T00:09:35.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = d7b198dc-e733-4bca-b939-33af3c5f926d response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88172024-11-05T00:09:36.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1ff4d6c2-0223-453c-91ef-0955039a00d5 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88182024-11-05T00:09:36.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1ff4d6c2-0223-453c-91ef-0955039a00d5 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88192024-11-05T00:09:36.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 1ff4d6c2-0223-453c-91ef-0955039a00d5 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88202024-11-05T00:09:36.882ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 836 local_addr = [fd00:1122:3344:101::b]:54938 method = GET remote_addr = [fd00:1122:3344:101::d]:39437 req_id = a5153498-3dd0-4420-b600-40cdda1aa3bc response_code = 200 uri = /96aa1415-4c39-4ede-a09d-b8326a8455f7
88212024-11-05T00:09:37.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 04adaeb5-877c-451e-82c5-f32954e0c4cd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88222024-11-05T00:09:37.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 04adaeb5-877c-451e-82c5-f32954e0c4cd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88232024-11-05T00:09:37.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 04adaeb5-877c-451e-82c5-f32954e0c4cd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88242024-11-05T00:09:38.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58de43d2-fe84-46e4-8b72-4831c0aa8c66 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88252024-11-05T00:09:38.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58de43d2-fe84-46e4-8b72-4831c0aa8c66 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88262024-11-05T00:09:38.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 58de43d2-fe84-46e4-8b72-4831c0aa8c66 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88272024-11-05T00:09:39.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 599e97e8-af8d-44bd-950f-221ef9f4d173 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88282024-11-05T00:09:39.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 599e97e8-af8d-44bd-950f-221ef9f4d173 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88292024-11-05T00:09:39.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 599e97e8-af8d-44bd-950f-221ef9f4d173 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88302024-11-05T00:09:40.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7b9d65ec-7e11-4613-a6bc-22fbf6aac4f0 roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88312024-11-05T00:09:40.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7b9d65ec-7e11-4613-a6bc-22fbf6aac4f0 resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88322024-11-05T00:09:40.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 7b9d65ec-7e11-4613-a6bc-22fbf6aac4f0 response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88332024-11-05T00:09:41.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4e690316-8a13-45a2-a779-fbba951fe67a roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88342024-11-05T00:09:41.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4e690316-8a13-45a2-a779-fbba951fe67a resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88352024-11-05T00:09:41.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 4e690316-8a13-45a2-a779-fbba951fe67a response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
88362024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
88372024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
88382024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88392024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88402024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88412024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
88422024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
88432024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
88442024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88452024-11-05T00:09:42.173ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970
88462024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.46\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970"}
88472024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
88482024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
88492024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88502024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
88512024-11-05T00:09:42.173ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88522024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88532024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
88542024-11-05T00:09:42.173ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
88552024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88562024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
88572024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
88582024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88592024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
88602024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88612024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
88622024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
88632024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88642024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
88652024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
88662024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
88672024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
88682024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
88692024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
88702024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88712024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
88722024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88732024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88742024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
88752024-11-05T00:09:42.173ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-04 23:59:42.173751041 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
88762024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
88772024-11-05T00:09:42.173ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
88782024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
88792024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88802024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88812024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
88822024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
88832024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
88842024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88852024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88862024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
88872024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88882024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
88892024-11-05T00:09:42.174ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
88902024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88912024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88922024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88932024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88942024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88952024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88962024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88972024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88982024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88992024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89002024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89012024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89022024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
89032024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
89042024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
89052024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89062024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
89072024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
89082024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89092024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
89102024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.6\u{b5}s iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
89112024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.01\u{b5}s iteration = 31 status = {"errors":[],"records_set_to_done":[]}
89122024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89132024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
89142024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
89152024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89162024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 14.361\u{b5}s iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89172024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.13\u{b5}s iteration = 31 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
89182024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89192024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89202024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89212024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89222024-11-05T00:09:42.174ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("08f058bf-bffa-4561-8799-2d5d32641d33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e5a3f00-3f5b-4cac-8aa4-99515a0afee2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3225, tv_nsec: 759517036 } })
89232024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
89242024-11-05T00:09:42.174ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f4c9dd5-dad6-4fc2-ba58-b064adbea295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d840e2fc-5a49-44c2-87c1-9190f4e47113.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3225, tv_nsec: 759524296 } })
89252024-11-05T00:09:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89262024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
89272024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89282024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89292024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
89302024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89312024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89322024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
89332024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.804837ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
89342024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89352024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89362024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
89372024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.803997ms iteration = 16 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
89382024-11-05T00:09:42.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89392024-11-05T00:09:42.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89402024-11-05T00:09:42.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89412024-11-05T00:09:42.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3225, tv_nsec: 761624510 } })
89422024-11-05T00:09:42.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
89432024-11-05T00:09:42.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89442024-11-05T00:09:42.177ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.704366ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89452024-11-05T00:09:42.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89462024-11-05T00:09:42.177ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89472024-11-05T00:09:42.178ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89482024-11-05T00:09:42.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89492024-11-05T00:09:42.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89502024-11-05T00:09:42.178ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3225, tv_nsec: 762975238 } })
89512024-11-05T00:09:42.178ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
89522024-11-05T00:09:42.179ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89532024-11-05T00:09:42.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89542024-11-05T00:09:42.180ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89552024-11-05T00:09:42.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89562024-11-05T00:09:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89572024-11-05T00:09:42.181ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89582024-11-05T00:09:42.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89592024-11-05T00:09:42.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89602024-11-05T00:09:42.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89612024-11-05T00:09:42.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89622024-11-05T00:09:42.183ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89632024-11-05T00:09:42.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89642024-11-05T00:09:42.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89652024-11-05T00:09:42.185ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89662024-11-05T00:09:42.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89672024-11-05T00:09:42.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89682024-11-05T00:09:42.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89692024-11-05T00:09:42.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89702024-11-05T00:09:42.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89712024-11-05T00:09:42.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89722024-11-05T00:09:42.188ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89732024-11-05T00:09:42.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89742024-11-05T00:09:42.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89752024-11-05T00:09:42.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89762024-11-05T00:09:42.191ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-04 23:59:42.173751041 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
89772024-11-05T00:09:42.191ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.947407ms iteration = 16 status = {"expiration":"2024-11-04T23:59:42.173751041Z","pruned":[]}
89782024-11-05T00:09:42.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89792024-11-05T00:09:42.191ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89802024-11-05T00:09:42.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89812024-11-05T00:09:42.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89822024-11-05T00:09:42.192ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89832024-11-05T00:09:42.194ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89842024-11-05T00:09:42.194ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.339318ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
89852024-11-05T00:09:42.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
89862024-11-05T00:09:42.195ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89872024-11-05T00:09:42.195ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
89882024-11-05T00:09:42.195ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
89892024-11-05T00:09:42.195ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.184535ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
89902024-11-05T00:09:42.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89912024-11-05T00:09:42.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
89922024-11-05T00:09:42.196ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89932024-11-05T00:09:42.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89942024-11-05T00:09:42.196ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89952024-11-05T00:09:42.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
89962024-11-05T00:09:42.202ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89972024-11-05T00:09:42.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89982024-11-05T00:09:42.202ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89992024-11-05T00:09:42.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
90002024-11-05T00:09:42.204ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90012024-11-05T00:09:42.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90022024-11-05T00:09:42.204ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90032024-11-05T00:09:42.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
90042024-11-05T00:09:42.206ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90052024-11-05T00:09:42.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90062024-11-05T00:09:42.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.845125ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90072024-11-05T00:09:42.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90082024-11-05T00:09:42.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90092024-11-05T00:09:42.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90102024-11-05T00:09:42.209ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90112024-11-05T00:09:42.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90122024-11-05T00:09:42.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90132024-11-05T00:09:42.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90142024-11-05T00:09:42.211ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90152024-11-05T00:09:42.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90162024-11-05T00:09:42.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3225, tv_nsec: 796306052 } })
90172024-11-05T00:09:42.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90182024-11-05T00:09:42.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
90192024-11-05T00:09:42.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90202024-11-05T00:09:42.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90212024-11-05T00:09:42.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90222024-11-05T00:09:42.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ad1cc1f1-ed3e-4b32-909b-1e7aedd1eacd roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
90232024-11-05T00:09:42.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90242024-11-05T00:09:42.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ad1cc1f1-ed3e-4b32-909b-1e7aedd1eacd resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
90252024-11-05T00:09:42.226ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90262024-11-05T00:09:42.227ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90272024-11-05T00:09:42.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90282024-11-05T00:09:42.231ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90292024-11-05T00:09:42.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
90302024-11-05T00:09:42.231ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90312024-11-05T00:09:42.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90322024-11-05T00:09:42.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
90332024-11-05T00:09:42.234ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90342024-11-05T00:09:42.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90352024-11-05T00:09:42.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 20317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = ad1cc1f1-ed3e-4b32-909b-1e7aedd1eacd response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
90362024-11-05T00:09:42.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90372024-11-05T00:09:42.235ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90382024-11-05T00:09:42.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90392024-11-05T00:09:42.237ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 63.696207ms iteration = 7 status = {"nsuccess":5}
90402024-11-05T00:09:42.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90412024-11-05T00:09:42.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90422024-11-05T00:09:42.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90432024-11-05T00:09:42.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90442024-11-05T00:09:42.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90452024-11-05T00:09:42.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90462024-11-05T00:09:42.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90472024-11-05T00:09:42.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90482024-11-05T00:09:42.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90492024-11-05T00:09:42.252ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90502024-11-05T00:09:42.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90512024-11-05T00:09:42.254ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90522024-11-05T00:09:42.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.437981ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90532024-11-05T00:09:42.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
90542024-11-05T00:09:42.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90552024-11-05T00:09:42.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90562024-11-05T00:09:42.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90572024-11-05T00:09:42.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90582024-11-05T00:09:42.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90592024-11-05T00:09:42.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90602024-11-05T00:09:42.273ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90612024-11-05T00:09:42.273ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90622024-11-05T00:09:42.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90632024-11-05T00:09:42.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90642024-11-05T00:09:42.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90652024-11-05T00:09:42.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90662024-11-05T00:09:42.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90672024-11-05T00:09:42.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90682024-11-05T00:09:42.279ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
90692024-11-05T00:09:42.279ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
90702024-11-05T00:09:42.279ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
90712024-11-05T00:09:42.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90722024-11-05T00:09:42.279ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
90732024-11-05T00:09:42.279ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
90742024-11-05T00:09:42.279ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
90752024-11-05T00:09:42.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90762024-11-05T00:09:42.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90772024-11-05T00:09:42.280ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90782024-11-05T00:09:42.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90792024-11-05T00:09:42.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90802024-11-05T00:09:42.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
90812024-11-05T00:09:42.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90822024-11-05T00:09:42.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90832024-11-05T00:09:42.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90842024-11-05T00:09:42.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90852024-11-05T00:09:42.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90862024-11-05T00:09:42.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90872024-11-05T00:09:42.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90882024-11-05T00:09:42.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90892024-11-05T00:09:42.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90902024-11-05T00:09:42.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90912024-11-05T00:09:42.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90922024-11-05T00:09:42.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90932024-11-05T00:09:42.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90942024-11-05T00:09:42.289ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
90952024-11-05T00:09:42.289ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
90962024-11-05T00:09:42.289ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 115.711635ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
90972024-11-05T00:09:42.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 08c4ce3c-6a01-4db0-bf71-cc6009488970, lookup_type: ById(08c4ce3c-6a01-4db0-bf71-cc6009488970) } result = Ok(())
90982024-11-05T00:09:42.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90992024-11-05T00:09:42.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91002024-11-05T00:09:42.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
91012024-11-05T00:09:42.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91022024-11-05T00:09:42.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91032024-11-05T00:09:42.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
91042024-11-05T00:09:42.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91052024-11-05T00:09:42.291ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91062024-11-05T00:09:42.293ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91072024-11-05T00:09:42.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91082024-11-05T00:09:42.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
91092024-11-05T00:09:42.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91102024-11-05T00:09:42.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91112024-11-05T00:09:42.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91122024-11-05T00:09:42.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91132024-11-05T00:09:42.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91142024-11-05T00:09:42.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91152024-11-05T00:09:42.299ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 125.380033ms iteration = 31 status = 0
91162024-11-05T00:09:42.300ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91172024-11-05T00:09:42.301ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 original_time_created = 2024-11-04 23:54:26.638126 UTC target_id = 08c4ce3c-6a01-4db0-bf71-cc6009488970 time_created = 2024-11-04 23:54:26.638126 UTC
91182024-11-05T00:09:42.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 127.64301ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"08c4ce3c-6a01-4db0-bf71-cc6009488970","time_created":"2024-11-04T23:54:26.638126Z"}
91192024-11-05T00:09:42.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91202024-11-05T00:09:42.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91212024-11-05T00:09:42.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91222024-11-05T00:09:42.303ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91232024-11-05T00:09:42.303ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91242024-11-05T00:09:42.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91252024-11-05T00:09:42.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91262024-11-05T00:09:42.305ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91272024-11-05T00:09:42.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91282024-11-05T00:09:42.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91292024-11-05T00:09:42.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91302024-11-05T00:09:42.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91312024-11-05T00:09:42.311ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
91322024-11-05T00:09:42.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
91332024-11-05T00:09:42.313ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91342024-11-05T00:09:42.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91352024-11-05T00:09:42.317ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91362024-11-05T00:09:42.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91372024-11-05T00:09:42.318ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
91382024-11-05T00:09:42.318ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 144.179429ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
91392024-11-05T00:09:42.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91402024-11-05T00:09:42.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91412024-11-05T00:09:42.323ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91422024-11-05T00:09:42.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91432024-11-05T00:09:42.332ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91442024-11-05T00:09:42.332ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
91452024-11-05T00:09:42.332ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.068554ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
91462024-11-05T00:09:42.333ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91472024-11-05T00:09:42.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91482024-11-05T00:09:42.336ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91492024-11-05T00:09:42.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91502024-11-05T00:09:42.339ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
91512024-11-05T00:09:42.339ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
91522024-11-05T00:09:42.339ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 0 version = 2
91532024-11-05T00:09:42.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91542024-11-05T00:09:42.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91552024-11-05T00:09:42.342ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
91562024-11-05T00:09:42.342ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
91572024-11-05T00:09:42.342ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91582024-11-05T00:09:42.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91592024-11-05T00:09:42.360ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
91602024-11-05T00:09:42.360ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91612024-11-05T00:09:42.360ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6021770-86aa-4226-aa1a-06a97a04a6bf", "content-length": "26", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
91622024-11-05T00:09:42.360ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91632024-11-05T00:09:42.363ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91642024-11-05T00:09:42.371ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-04T23:54:39.943212Z, time_modified: 2024-11-04T23:54:39.943212Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, db_silo: Silo { identity: SiloIdentity { id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-04T23:54:44.965306Z, time_modified: 2024-11-04T23:54:44.965306Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4" }] }) }
91652024-11-05T00:09:42.371ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 197.265709ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]}},"default_endpoint":{"silo_id":"73cac2e6-afc3-4b45-b597-79dfc81e8ecd","tls_certs":["a0ef76bb02f5db072502880b64d8db295a275f1f1ed6beca2bc32e4d8ae3b1d4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
91662024-11-05T00:09:42.381ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 zone_address = fd00:1122:3344:101::2
91672024-11-05T00:09:42.381ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91682024-11-05T00:09:42.381ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc3ef0fd-6d3d-4c51-a67d-c4e923030780", "content-length": "26", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
91692024-11-05T00:09:42.381ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91702024-11-05T00:09:42.386ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 212.988841ms iteration = 34 status = {"physical_disks_added":0}
91712024-11-05T00:09:42.388ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
91722024-11-05T00:09:42.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
91732024-11-05T00:09:42.393ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91742024-11-05T00:09:42.393ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0e4e018-f68d-4a2e-b2f2-c0dccf75c568", "content-length": "26", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
91752024-11-05T00:09:42.393ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91762024-11-05T00:09:42.395ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91772024-11-05T00:09:42.427ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
91782024-11-05T00:09:42.427ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 254.267948ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
91792024-11-05T00:09:42.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91802024-11-05T00:09:42.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91812024-11-05T00:09:42.473ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
91822024-11-05T00:09:42.473ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e7aa9305-e7f1-4c99-88ee-61720fd5fbb1", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91832024-11-05T00:09:42.473ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91842024-11-05T00:09:42.475ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "68d261d6-2107-49b4-bfb3-25cafae4c7de", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91852024-11-05T00:09:42.475ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91862024-11-05T00:09:42.477ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91872024-11-05T00:09:42.477ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 303.983239ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
91882024-11-05T00:09:42.533ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
91892024-11-05T00:09:42.533ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91902024-11-05T00:09:42.534ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c286f6b-8bad-4901-a1f2-bf5480d07254", "content-length": "372", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
91912024-11-05T00:09:42.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91922024-11-05T00:09:42.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91932024-11-05T00:09:42.535ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91942024-11-05T00:09:42.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91952024-11-05T00:09:42.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91962024-11-05T00:09:42.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91972024-11-05T00:09:42.537ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91982024-11-05T00:09:42.537ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91992024-11-05T00:09:42.538ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 365.277048ms iteration = 31 status = {}
92002024-11-05T00:09:42.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92012024-11-05T00:09:42.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92022024-11-05T00:09:42.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92032024-11-05T00:09:42.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92042024-11-05T00:09:42.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92052024-11-05T00:09:42.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92062024-11-05T00:09:42.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92072024-11-05T00:09:42.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92082024-11-05T00:09:42.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92092024-11-05T00:09:42.543ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0f2b085c-193d-49df-b69d-e0661892b69f dns_zone_name = oxide.test found_so_far = 1 version = 2
92102024-11-05T00:09:42.543ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
92112024-11-05T00:09:42.543ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-04 23:54:45.073528 UTC dns_group = external generation = 2
92122024-11-05T00:09:42.543ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 369.639748ms iteration = 16 status = {"generation":2}
92132024-11-05T00:09:42.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
92142024-11-05T00:09:42.543ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92152024-11-05T00:09:42.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92162024-11-05T00:09:42.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92172024-11-05T00:09:42.545ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 26188ba4-e82e-41a0-a132-9dbf38d2f101 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
92182024-11-05T00:09:42.545ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
92192024-11-05T00:09:42.545ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-04 23:54:43.769339 UTC dns_group = internal generation = 1
92202024-11-05T00:09:42.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 372.21512ms iteration = 16 status = {"generation":1}
92212024-11-05T00:09:42.546ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92222024-11-05T00:09:42.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92232024-11-05T00:09:42.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92242024-11-05T00:09:42.546ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92252024-11-05T00:09:42.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92262024-11-05T00:09:42.547ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92272024-11-05T00:09:42.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92282024-11-05T00:09:42.549ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92292024-11-05T00:09:42.553ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
92302024-11-05T00:09:42.553ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
92312024-11-05T00:09:42.553ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f68fccad-b590-4e78-8e5f-adc962e8f938", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
92322024-11-05T00:09:42.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92332024-11-05T00:09:42.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92342024-11-05T00:09:42.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
92352024-11-05T00:09:42.555ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92362024-11-05T00:09:42.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92372024-11-05T00:09:42.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92382024-11-05T00:09:42.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92392024-11-05T00:09:42.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92402024-11-05T00:09:42.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92412024-11-05T00:09:42.561ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92422024-11-05T00:09:42.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92432024-11-05T00:09:42.613ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
92442024-11-05T00:09:42.674ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92452024-11-05T00:09:42.675ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92462024-11-05T00:09:42.675ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a5fb152-2fad-48b9-ae41-9c2adb356cec", "content-length": "2", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
92472024-11-05T00:09:42.675ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0f5ed5f-6f13-41cf-9af7-d0767b12a7d4", "content-length": "691", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
92482024-11-05T00:09:42.675ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
92492024-11-05T00:09:42.675ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
92502024-11-05T00:09:42.675ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
92512024-11-05T00:09:42.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92522024-11-05T00:09:42.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92532024-11-05T00:09:42.678ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92542024-11-05T00:09:42.678ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 504.991046ms iteration = 32 status = {}
92552024-11-05T00:09:42.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92562024-11-05T00:09:42.679ZINFOnexus (BackgroundTasks): VPC route manager sled e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
92572024-11-05T00:09:42.679ZDEBGnexus (BackgroundTasks): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92582024-11-05T00:09:42.679ZDEBGnexus (BackgroundTasks): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ef4a98b8-ec88-41a1-ae42-007196b6308a", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
92592024-11-05T00:09:42.679ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92602024-11-05T00:09:42.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92612024-11-05T00:09:42.680ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 507.459177ms iteration = 31 status = null
92622024-11-05T00:09:42.680ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 507.479507ms iteration = 32 status = {}
92632024-11-05T00:09:42.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92642024-11-05T00:09:42.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92652024-11-05T00:09:42.683ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92662024-11-05T00:09:42.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92672024-11-05T00:09:42.685ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92682024-11-05T00:09:42.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92692024-11-05T00:09:42.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92702024-11-05T00:09:42.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92712024-11-05T00:09:42.688ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92722024-11-05T00:09:42.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
92732024-11-05T00:09:42.692ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92742024-11-05T00:09:42.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92752024-11-05T00:09:42.693ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92762024-11-05T00:09:42.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92772024-11-05T00:09:42.695ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92782024-11-05T00:09:42.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92792024-11-05T00:09:42.697ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92802024-11-05T00:09:42.700ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
92812024-11-05T00:09:42.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92822024-11-05T00:09:42.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92832024-11-05T00:09:42.706ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
92842024-11-05T00:09:42.706ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92852024-11-05T00:09:42.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92862024-11-05T00:09:42.707ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92872024-11-05T00:09:42.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
92882024-11-05T00:09:42.709ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92892024-11-05T00:09:42.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92902024-11-05T00:09:42.710ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
92912024-11-05T00:09:42.710ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
92922024-11-05T00:09:42.710ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
92932024-11-05T00:09:42.721ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
92942024-11-05T00:09:42.722ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "090e43cc-be9f-4286-9786-8dbe19e1f8bf", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92952024-11-05T00:09:42.722ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92962024-11-05T00:09:42.724ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "cd280463-1f50-4735-8616-62ee870c2f80", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92972024-11-05T00:09:42.724ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92982024-11-05T00:09:42.726ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a7c437bf-cb39-4ab0-bcbb-cff5fd935e3d", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92992024-11-05T00:09:42.726ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93002024-11-05T00:09:42.728ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93012024-11-05T00:09:42.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 554.597544ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
93022024-11-05T00:09:42.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93032024-11-05T00:09:42.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93042024-11-05T00:09:42.736ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de43dad7-1e90-49bf-9efa-ce2640c38960, rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e2192f65-0e93-48ad-9a03-8a2c54174fd2) } rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
93052024-11-05T00:09:42.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93062024-11-05T00:09:42.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93072024-11-05T00:09:42.747ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93082024-11-05T00:09:42.748ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f26aeeb-32d6-47d8-864b-164076d03e33", "content-length": "134", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
93092024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93102024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e2192f65-0e93-48ad-9a03-8a2c54174fd2
93112024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93122024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93132024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93142024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93152024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93162024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93172024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93182024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93192024-11-05T00:09:42.748ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783
93202024-11-05T00:09:42.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93212024-11-05T00:09:42.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93222024-11-05T00:09:42.751ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93232024-11-05T00:09:42.751ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb4db885-a0a0-40fe-b7bb-71d50e0927c2", "content-length": "2", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
93242024-11-05T00:09:42.751ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93252024-11-05T00:09:42.751ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cebf4fc1-ecbd-43b8-86ad-ee67f025e505", "content-length": "52", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
93262024-11-05T00:09:42.751ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch_location = Switch0
93272024-11-05T00:09:42.751ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93282024-11-05T00:09:42.773ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, time_created: 2024-11-04T23:54:41.796370Z, time_modified: 2024-11-04T23:54:41.796370Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
93292024-11-05T00:09:42.773ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
93302024-11-05T00:09:42.773ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93312024-11-05T00:09:42.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93322024-11-05T00:09:42.776ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93332024-11-05T00:09:42.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93342024-11-05T00:09:42.778ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93352024-11-05T00:09:42.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29, lookup_type: ById(e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) } result = Ok(())
93362024-11-05T00:09:42.811ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
93372024-11-05T00:09:42.876ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2bc63307-55bc-4618-89d9-a7f42599fa12", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
93382024-11-05T00:09:42.876ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 switch = Switch0
93392024-11-05T00:09:42.876ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93402024-11-05T00:09:42.876ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8c1d2eb7-1489-42d7-9ade-7cb4bea90783 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8312f946-1d21-4d59-8dc8-3a6f63c592bd", "content-length": "682", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
93412024-11-05T00:09:42.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93422024-11-05T00:09:42.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93432024-11-05T00:09:42.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93442024-11-05T00:09:42.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93452024-11-05T00:09:42.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93462024-11-05T00:09:42.885ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "533e5726-7411-42da-a69e-ade70ffdab98", "date": "Tue, 05 Nov 2024 00:09:42 GMT"} })
93472024-11-05T00:09:42.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93482024-11-05T00:09:42.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93492024-11-05T00:09:42.887ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
93502024-11-05T00:09:42.887ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 713.852953ms
93512024-11-05T00:09:42.887ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 713.867814ms iteration = 4 status = {}
93522024-11-05T00:09:42.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93532024-11-05T00:09:42.894ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 720.456629ms iteration = 31 status = {}
93542024-11-05T00:09:43.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 49d65400-b643-48a2-8e99-d514dded589b roles = RoleSet { roles: {} } uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
93552024-11-05T00:09:43.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 49d65400-b643-48a2-8e99-d514dded589b resource = Database result = Ok(()) uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
93562024-11-05T00:09:43.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48968 req_id = 49d65400-b643-48a2-8e99-d514dded589b response_code = 200 uri = /probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29