Max level shown:
12024-11-01T08:30:01.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 56cc05a5-133a-4428-84fb-7e6c63803092 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22024-11-01T08:30:01.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 56cc05a5-133a-4428-84fb-7e6c63803092 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
32024-11-01T08:30:01.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 56cc05a5-133a-4428-84fb-7e6c63803092 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42024-11-01T08:30:02.469ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35992
52024-11-01T08:30:02.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35992 req_id = 73c94188-ee14-468e-9596-80ece1c80712 roles = RoleSet { roles: {} } uri = /metrics/producers
62024-11-01T08:30:02.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35992 req_id = 73c94188-ee14-468e-9596-80ece1c80712 resource = Database result = Ok(()) uri = /metrics/producers
72024-11-01T08:30:02.518ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = 2bd8d4c6-9800-41ac-b72e-4afab6fc2f46
82024-11-01T08:30:02.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48992 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35992 req_id = 73c94188-ee14-468e-9596-80ece1c80712 response_code = 201 uri = /metrics/producers
92024-11-01T08:30:02.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 014f0975-2423-4950-94c7-876f894e6a54 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
102024-11-01T08:30:02.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 014f0975-2423-4950-94c7-876f894e6a54 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
112024-11-01T08:30:02.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 014f0975-2423-4950-94c7-876f894e6a54 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
122024-11-01T08:30:04.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 101aa2eb-4914-4e6b-9f0e-149f6d9b5847 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
132024-11-01T08:30:04.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 101aa2eb-4914-4e6b-9f0e-149f6d9b5847 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
142024-11-01T08:30:04.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 101aa2eb-4914-4e6b-9f0e-149f6d9b5847 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
152024-11-01T08:30:04.697ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
162024-11-01T08:30:04.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
172024-11-01T08:30:04.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
182024-11-01T08:30:04.698ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
192024-11-01T08:30:04.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
202024-11-01T08:30:04.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
212024-11-01T08:30:04.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
222024-11-01T08:30:04.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
232024-11-01T08:30:04.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
242024-11-01T08:30:04.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
252024-11-01T08:30:04.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
262024-11-01T08:30:04.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
272024-11-01T08:30:04.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
282024-11-01T08:30:04.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
292024-11-01T08:30:04.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
302024-11-01T08:30:04.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
312024-11-01T08:30:04.721ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
322024-11-01T08:30:04.721ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.233351ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
332024-11-01T08:30:04.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
342024-11-01T08:30:04.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
352024-11-01T08:30:04.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.757524ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
362024-11-01T08:30:05.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a12406af-4764-4573-aab9-2e9d03f53800 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
372024-11-01T08:30:05.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a12406af-4764-4573-aab9-2e9d03f53800 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
382024-11-01T08:30:05.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a12406af-4764-4573-aab9-2e9d03f53800 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
392024-11-01T08:30:05.211ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 91ba279d-dd05-492f-94ce-1e5ed89ebfa7 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
402024-11-01T08:30:05.599ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61651
412024-11-01T08:30:05.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61651 req_id = 795501ca-21a2-443e-be09-da32f0d62047 roles = RoleSet { roles: {} } uri = /metrics/producers
422024-11-01T08:30:05.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61651 req_id = 795501ca-21a2-443e-be09-da32f0d62047 resource = Database result = Ok(()) uri = /metrics/producers
432024-11-01T08:30:05.609ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = 3735dd72-b7e1-429d-8105-2c95027a9081
442024-11-01T08:30:05.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10194 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61651 req_id = 795501ca-21a2-443e-be09-da32f0d62047 response_code = 201 uri = /metrics/producers
452024-11-01T08:30:06.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0f51e9a1-74f1-4b8e-93ad-df899f3f6462 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
462024-11-01T08:30:06.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0f51e9a1-74f1-4b8e-93ad-df899f3f6462 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
472024-11-01T08:30:06.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0f51e9a1-74f1-4b8e-93ad-df899f3f6462 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
482024-11-01T08:30:07.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fb7e2c3c-355c-4526-82c2-f02b4e140d31 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
492024-11-01T08:30:07.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fb7e2c3c-355c-4526-82c2-f02b4e140d31 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
502024-11-01T08:30:07.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fb7e2c3c-355c-4526-82c2-f02b4e140d31 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
512024-11-01T08:30:08.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e89c2cde-064e-4adf-805c-99da23f6b3fa roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
522024-11-01T08:30:08.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e89c2cde-064e-4adf-805c-99da23f6b3fa resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
532024-11-01T08:30:08.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e89c2cde-064e-4adf-805c-99da23f6b3fa response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
542024-11-01T08:30:09.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 479b0a31-8db9-49f9-932b-7070fbb2e11f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
552024-11-01T08:30:09.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 479b0a31-8db9-49f9-932b-7070fbb2e11f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
562024-11-01T08:30:09.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 479b0a31-8db9-49f9-932b-7070fbb2e11f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
572024-11-01T08:30:10.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d77f8857-0f1b-43f7-8aec-0ad1ec587283 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
582024-11-01T08:30:10.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d77f8857-0f1b-43f7-8aec-0ad1ec587283 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
592024-11-01T08:30:10.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d77f8857-0f1b-43f7-8aec-0ad1ec587283 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
602024-11-01T08:30:11.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2d103020-40ac-4583-997c-663478f789d4 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
612024-11-01T08:30:11.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2d103020-40ac-4583-997c-663478f789d4 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
622024-11-01T08:30:11.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2d103020-40ac-4583-997c-663478f789d4 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
632024-11-01T08:30:11.667ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:62328
642024-11-01T08:30:11.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62328 req_id = 3d68449d-b388-433e-b6fa-006ad7ba5f9f roles = RoleSet { roles: {} } uri = /metrics/producers
652024-11-01T08:30:11.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62328 req_id = 3d68449d-b388-433e-b6fa-006ad7ba5f9f resource = Database result = Ok(()) uri = /metrics/producers
662024-11-01T08:30:11.711ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = a222b9b7-131e-465b-8e67-8290950a717e
672024-11-01T08:30:11.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43481 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62328 req_id = 3d68449d-b388-433e-b6fa-006ad7ba5f9f response_code = 201 uri = /metrics/producers
682024-11-01T08:30:12.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 55040548-45bc-42bf-8039-8bc10e0072ee roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
692024-11-01T08:30:12.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 55040548-45bc-42bf-8039-8bc10e0072ee resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
702024-11-01T08:30:12.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 55040548-45bc-42bf-8039-8bc10e0072ee response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
712024-11-01T08:30:13.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a9ae5c09-e899-4604-a40a-910ce4599d9d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
722024-11-01T08:30:13.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a9ae5c09-e899-4604-a40a-910ce4599d9d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
732024-11-01T08:30:13.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a9ae5c09-e899-4604-a40a-910ce4599d9d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
742024-11-01T08:30:13.754ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:58052
752024-11-01T08:30:13.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58052 req_id = fe4d704b-5e2b-4a8d-9005-90f5d5714f24 roles = RoleSet { roles: {} } uri = /metrics/producers
762024-11-01T08:30:13.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58052 req_id = fe4d704b-5e2b-4a8d-9005-90f5d5714f24 resource = Database result = Ok(()) uri = /metrics/producers
772024-11-01T08:30:13.764ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
782024-11-01T08:30:13.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10295 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58052 req_id = fe4d704b-5e2b-4a8d-9005-90f5d5714f24 response_code = 201 uri = /metrics/producers
792024-11-01T08:30:14.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ec70579e-393c-4e7f-ae87-abff8842f28a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
802024-11-01T08:30:14.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ec70579e-393c-4e7f-ae87-abff8842f28a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
812024-11-01T08:30:14.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ec70579e-393c-4e7f-ae87-abff8842f28a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
822024-11-01T08:30:14.697ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
832024-11-01T08:30:14.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
842024-11-01T08:30:14.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
852024-11-01T08:30:14.698ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
862024-11-01T08:30:14.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
872024-11-01T08:30:14.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
882024-11-01T08:30:14.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
892024-11-01T08:30:14.699ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
902024-11-01T08:30:14.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
912024-11-01T08:30:14.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
922024-11-01T08:30:14.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
932024-11-01T08:30:14.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.202743ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
942024-11-01T08:30:14.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
952024-11-01T08:30:14.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
962024-11-01T08:30:14.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
972024-11-01T08:30:14.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
982024-11-01T08:30:14.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
992024-11-01T08:30:14.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1002024-11-01T08:30:14.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1012024-11-01T08:30:14.716ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
1022024-11-01T08:30:14.716ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.866154ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
1032024-11-01T08:30:15.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 597e7b53-bcac-4dfe-a1e4-fda3276c9b99 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1042024-11-01T08:30:15.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 597e7b53-bcac-4dfe-a1e4-fda3276c9b99 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1052024-11-01T08:30:15.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 597e7b53-bcac-4dfe-a1e4-fda3276c9b99 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1062024-11-01T08:30:16.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dee3cfab-0e15-49a0-aca0-c92d55b3e8b4 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1072024-11-01T08:30:16.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dee3cfab-0e15-49a0-aca0-c92d55b3e8b4 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1082024-11-01T08:30:16.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dee3cfab-0e15-49a0-aca0-c92d55b3e8b4 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1092024-11-01T08:30:16.412ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33061
1102024-11-01T08:30:16.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33061 req_id = cfd86885-eca9-4d39-8f34-48e3418cf760 roles = RoleSet { roles: {} } uri = /metrics/producers
1112024-11-01T08:30:16.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33061 req_id = cfd86885-eca9-4d39-8f34-48e3418cf760 resource = Database result = Ok(()) uri = /metrics/producers
1122024-11-01T08:30:16.422ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = 71e16aab-fabd-48da-9122-0ddfcab1e2c2
1132024-11-01T08:30:16.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10139 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33061 req_id = cfd86885-eca9-4d39-8f34-48e3418cf760 response_code = 201 uri = /metrics/producers
1142024-11-01T08:30:17.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 68ad694d-dacf-40cf-a65d-16fb0b42670f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1152024-11-01T08:30:17.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 68ad694d-dacf-40cf-a65d-16fb0b42670f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1162024-11-01T08:30:17.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 68ad694d-dacf-40cf-a65d-16fb0b42670f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1172024-11-01T08:30:18.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1d20129f-308d-4b84-8f83-af5df83b1a7c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1182024-11-01T08:30:18.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1d20129f-308d-4b84-8f83-af5df83b1a7c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1192024-11-01T08:30:18.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1d20129f-308d-4b84-8f83-af5df83b1a7c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1202024-11-01T08:30:19.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1663eaf9-74c4-4e76-af60-4631d59e9d6a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1212024-11-01T08:30:19.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1663eaf9-74c4-4e76-af60-4631d59e9d6a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1222024-11-01T08:30:19.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1663eaf9-74c4-4e76-af60-4631d59e9d6a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1232024-11-01T08:30:20.203ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1716 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = b796ed01-93cb-4c47-9d5c-acea02c2d882 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
1242024-11-01T08:30:20.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = be2f241c-b9ea-49cb-8de0-5ee085006cb0 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1252024-11-01T08:30:20.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = be2f241c-b9ea-49cb-8de0-5ee085006cb0 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1262024-11-01T08:30:20.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = be2f241c-b9ea-49cb-8de0-5ee085006cb0 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1272024-11-01T08:30:21.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 305b2a5a-3137-45c1-a63d-bf6ccdf469fb roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1282024-11-01T08:30:21.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 305b2a5a-3137-45c1-a63d-bf6ccdf469fb resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1292024-11-01T08:30:21.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 305b2a5a-3137-45c1-a63d-bf6ccdf469fb response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1302024-11-01T08:30:22.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9e70b88c-e18c-41d4-aecf-61f38acefdc6 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1312024-11-01T08:30:22.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9e70b88c-e18c-41d4-aecf-61f38acefdc6 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1322024-11-01T08:30:22.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9e70b88c-e18c-41d4-aecf-61f38acefdc6 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1332024-11-01T08:30:23.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 121ac977-f645-4c40-b382-b5b85a721894 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1342024-11-01T08:30:23.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 121ac977-f645-4c40-b382-b5b85a721894 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1352024-11-01T08:30:23.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 121ac977-f645-4c40-b382-b5b85a721894 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1362024-11-01T08:30:24.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9db91231-3416-4074-abfa-f934ead2624f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1372024-11-01T08:30:24.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9db91231-3416-4074-abfa-f934ead2624f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1382024-11-01T08:30:24.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9db91231-3416-4074-abfa-f934ead2624f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
1392024-11-01T08:30:24.697ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
1402024-11-01T08:30:24.697ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
1412024-11-01T08:30:24.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1422024-11-01T08:30:24.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1432024-11-01T08:30:24.697ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
1442024-11-01T08:30:24.697ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
1452024-11-01T08:30:24.697ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1462024-11-01T08:30:24.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
1472024-11-01T08:30:24.697ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
1482024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1492024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
1502024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1512024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
1522024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1532024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
1542024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1552024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1562024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
1572024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1582024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
1592024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.34\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
1602024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
1612024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
1622024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.111\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1632024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
1642024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.95\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1652024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1662024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1672024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
1682024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
1692024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.07\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
1702024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
1712024-11-01T08:30:24.698ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1722024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1732024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1742024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1752024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1762024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1772024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1782024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1792024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1802024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1812024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1822024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1832024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1842024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1852024-11-01T08:30:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1862024-11-01T08:30:24.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1872024-11-01T08:30:24.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1882024-11-01T08:30:24.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1892024-11-01T08:30:24.702ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.158552ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1902024-11-01T08:30:24.702ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1912024-11-01T08:30:24.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1922024-11-01T08:30:24.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1932024-11-01T08:30:24.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1942024-11-01T08:30:24.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1952024-11-01T08:30:24.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1962024-11-01T08:30:24.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1972024-11-01T08:30:24.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1982024-11-01T08:30:24.705ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1992024-11-01T08:30:24.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2002024-11-01T08:30:24.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2012024-11-01T08:30:24.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2022024-11-01T08:30:24.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2032024-11-01T08:30:24.708ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4789, tv_nsec: 551925078 } })
2042024-11-01T08:30:24.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2052024-11-01T08:30:24.708ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
2062024-11-01T08:30:24.709ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4789, tv_nsec: 552832460 } })
2072024-11-01T08:30:24.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2082024-11-01T08:30:24.709ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
2092024-11-01T08:30:24.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2102024-11-01T08:30:24.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2112024-11-01T08:30:24.711ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4789, tv_nsec: 555208379 } })
2122024-11-01T08:30:24.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2132024-11-01T08:30:24.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2142024-11-01T08:30:24.712ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
2152024-11-01T08:30:24.712ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2162024-11-01T08:30:24.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2172024-11-01T08:30:24.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2182024-11-01T08:30:24.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2192024-11-01T08:30:24.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2202024-11-01T08:30:24.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2212024-11-01T08:30:24.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2222024-11-01T08:30:24.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2232024-11-01T08:30:24.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2242024-11-01T08:30:24.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
2252024-11-01T08:30:24.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2262024-11-01T08:30:24.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2272024-11-01T08:30:24.720ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2282024-11-01T08:30:24.720ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.663747ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2292024-11-01T08:30:24.738ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
2302024-11-01T08:30:24.738ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.750271ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
2312024-11-01T08:30:24.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2322024-11-01T08:30:24.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2332024-11-01T08:30:24.750ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2342024-11-01T08:30:24.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2352024-11-01T08:30:24.752ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2362024-11-01T08:30:24.752ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2372024-11-01T08:30:24.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2382024-11-01T08:30:24.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2392024-11-01T08:30:24.757ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2402024-11-01T08:30:24.757ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2412024-11-01T08:30:24.757ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2422024-11-01T08:30:24.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2432024-11-01T08:30:24.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2442024-11-01T08:30:24.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2452024-11-01T08:30:24.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2462024-11-01T08:30:24.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2472024-11-01T08:30:24.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2482024-11-01T08:30:24.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2492024-11-01T08:30:24.760ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.027964ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2502024-11-01T08:30:24.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2512024-11-01T08:30:24.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2522024-11-01T08:30:24.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2532024-11-01T08:30:24.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2542024-11-01T08:30:24.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2552024-11-01T08:30:24.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2562024-11-01T08:30:24.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2572024-11-01T08:30:24.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2582024-11-01T08:30:24.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.941367ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2592024-11-01T08:30:24.793ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2602024-11-01T08:30:24.793ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2612024-11-01T08:30:24.793ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.006924ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2622024-11-01T08:30:24.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2632024-11-01T08:30:24.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f7fe3bf0-db6a-428d-8129-f334aa61483d, lookup_type: ById(f7fe3bf0-db6a-428d-8129-f334aa61483d) } result = Ok(())
2642024-11-01T08:30:24.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2652024-11-01T08:30:24.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2662024-11-01T08:30:24.802ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
2672024-11-01T08:30:24.802ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2682024-11-01T08:30:24.802ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "644dd4f6-95a3-4824-b94d-88b0b9e93100", "content-length": "26", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
2692024-11-01T08:30:24.802ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2702024-11-01T08:30:24.802ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.689923ms iteration = 22 status = 0
2712024-11-01T08:30:24.803ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
2722024-11-01T08:30:24.803ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2732024-11-01T08:30:24.804ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a311774-5bda-4ea1-99c8-e143fb28974e", "content-length": "26", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
2742024-11-01T08:30:24.804ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2752024-11-01T08:30:24.804ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2762024-11-01T08:30:24.805ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2772024-11-01T08:30:24.816ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 zone_address = fd00:1122:3344:101::2
2782024-11-01T08:30:24.816ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2792024-11-01T08:30:24.816ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af6b1ae3-f440-4dab-95bd-e7f274b06390", "content-length": "26", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
2802024-11-01T08:30:24.816ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2812024-11-01T08:30:24.821ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
2822024-11-01T08:30:24.864ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 166.82225ms iteration = 26 status = {"physical_disks_added":0}
2832024-11-01T08:30:24.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2842024-11-01T08:30:24.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2852024-11-01T08:30:24.884ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 186.75286ms iteration = 22 status = {}
2862024-11-01T08:30:24.886ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2872024-11-01T08:30:24.886ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e90f9b64-ac33-4abf-991a-b887ed5f419a", "content-length": "1", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
2882024-11-01T08:30:24.887ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2892024-11-01T08:30:24.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2902024-11-01T08:30:24.889ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 191.696421ms iteration = 22 status = null
2912024-11-01T08:30:24.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2922024-11-01T08:30:24.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2932024-11-01T08:30:24.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2942024-11-01T08:30:24.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2952024-11-01T08:30:24.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2962024-11-01T08:30:24.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2972024-11-01T08:30:24.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2982024-11-01T08:30:24.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2992024-11-01T08:30:24.906ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3002024-11-01T08:30:24.906ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3012024-11-01T08:30:24.907ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "30dd8ded-9f70-44ee-a557-df991ce1cba5", "content-length": "372", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
3022024-11-01T08:30:24.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3032024-11-01T08:30:24.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3042024-11-01T08:30:24.957ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
3052024-11-01T08:30:24.957ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3062024-11-01T08:30:24.957ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dd312a53-b878-44ea-854f-1f2c55140edd", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
3072024-11-01T08:30:24.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3082024-11-01T08:30:24.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3092024-11-01T08:30:24.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3102024-11-01T08:30:24.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3112024-11-01T08:30:24.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3122024-11-01T08:30:24.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3132024-11-01T08:30:24.972ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3142024-11-01T08:30:24.973ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d4b9dae-b09c-48af-a113-a811a97fcabe", "content-length": "691", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
3152024-11-01T08:30:24.973ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
3162024-11-01T08:30:24.973ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3172024-11-01T08:30:24.973ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3182024-11-01T08:30:24.974ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 276.728681ms iteration = 22 status = {}
3192024-11-01T08:30:24.979ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3202024-11-01T08:30:24.979ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3212024-11-01T08:30:24.979ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "197d2962-a48a-4fb6-9c9a-9c2fefb2bf25", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
3222024-11-01T08:30:24.981ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 283.404415ms iteration = 23 status = {}
3232024-11-01T08:30:25.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3242024-11-01T08:30:25.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3252024-11-01T08:30:25.009ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e2aedfd9-3b4d-40ab-920a-0ddf803678fe, rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a0c3e848-f136-4ae5-b986-95beae550c75) } rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
3262024-11-01T08:30:25.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3272024-11-01T08:30:25.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3282024-11-01T08:30:25.024ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3292024-11-01T08:30:25.024ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "26e230be-b5ff-4557-8557-153071b6b4ef", "content-length": "121", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
3302024-11-01T08:30:25.024ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
3312024-11-01T08:30:25.024ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a0c3e848-f136-4ae5-b986-95beae550c75
3322024-11-01T08:30:25.024ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3332024-11-01T08:30:25.024ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3342024-11-01T08:30:25.024ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3352024-11-01T08:30:25.024ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3362024-11-01T08:30:25.024ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3372024-11-01T08:30:25.024ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3382024-11-01T08:30:25.025ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3392024-11-01T08:30:25.025ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3402024-11-01T08:30:25.025ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
3412024-11-01T08:30:25.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3422024-11-01T08:30:25.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3432024-11-01T08:30:25.028ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3442024-11-01T08:30:25.028ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1148cc7a-d768-476d-9e4e-ff05d75002ce", "content-length": "2", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
3452024-11-01T08:30:25.028ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3462024-11-01T08:30:25.028ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c8c29af-bb3d-4e2f-9600-f62f1384c32d", "content-length": "52", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
3472024-11-01T08:30:25.028ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
3482024-11-01T08:30:25.028ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3492024-11-01T08:30:25.151ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9d154ea5-c4b8-4428-ab5e-217b79e8883b", "date": "Fri, 01 Nov 2024 08:30:24 GMT"} })
3502024-11-01T08:30:25.151ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch = Switch0
3512024-11-01T08:30:25.151ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3522024-11-01T08:30:25.152ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "aacc71eb-4b63-4a36-b142-52e274bec674", "content-length": "669", "date": "Fri, 01 Nov 2024 08:30:25 GMT"} })
3532024-11-01T08:30:25.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3542024-11-01T08:30:25.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3552024-11-01T08:30:25.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3562024-11-01T08:30:25.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3572024-11-01T08:30:25.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3582024-11-01T08:30:25.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3592024-11-01T08:30:25.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3602024-11-01T08:30:25.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3612024-11-01T08:30:25.169ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 471.820925ms iteration = 22 status = {}
3622024-11-01T08:30:25.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 8604d0dd-8619-4014-9c20-b83b8b657cc9 roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
3632024-11-01T08:30:25.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 8604d0dd-8619-4014-9c20-b83b8b657cc9 resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
3642024-11-01T08:30:25.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 8604d0dd-8619-4014-9c20-b83b8b657cc9 response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
3652024-11-01T08:30:25.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 669fb7f6-17b1-4864-ad15-63bf6650d0b7 roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
3662024-11-01T08:30:25.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 669fb7f6-17b1-4864-ad15-63bf6650d0b7 resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
3672024-11-01T08:30:25.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 669fb7f6-17b1-4864-ad15-63bf6650d0b7 response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
3682024-11-01T08:30:25.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 8e1d3e53-8a6c-4f18-8d24-ee390200c9c1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3692024-11-01T08:30:25.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 8e1d3e53-8a6c-4f18-8d24-ee390200c9c1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3702024-11-01T08:30:25.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3618 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 8e1d3e53-8a6c-4f18-8d24-ee390200c9c1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3712024-11-01T08:30:25.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 01dc245a-6e88-42b3-bc14-068437299ab3 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3722024-11-01T08:30:25.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 01dc245a-6e88-42b3-bc14-068437299ab3 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3732024-11-01T08:30:25.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 01dc245a-6e88-42b3-bc14-068437299ab3 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3742024-11-01T08:30:26.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0de40830-3998-4683-88a1-f64f0356b21e roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3752024-11-01T08:30:26.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0de40830-3998-4683-88a1-f64f0356b21e resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3762024-11-01T08:30:26.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0de40830-3998-4683-88a1-f64f0356b21e response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3772024-11-01T08:30:27.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 185b5458-d88a-4250-b10e-14f0fca38e37 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3782024-11-01T08:30:27.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 185b5458-d88a-4250-b10e-14f0fca38e37 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3792024-11-01T08:30:27.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2907 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 185b5458-d88a-4250-b10e-14f0fca38e37 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3802024-11-01T08:30:28.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3a5f7201-1eb9-43f6-8c59-675866d769d1 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3812024-11-01T08:30:28.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3a5f7201-1eb9-43f6-8c59-675866d769d1 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3822024-11-01T08:30:28.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3a5f7201-1eb9-43f6-8c59-675866d769d1 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3832024-11-01T08:30:29.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9b2cbb8f-2a6f-473e-b97e-154649828c90 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3842024-11-01T08:30:29.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9b2cbb8f-2a6f-473e-b97e-154649828c90 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3852024-11-01T08:30:29.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9b2cbb8f-2a6f-473e-b97e-154649828c90 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3862024-11-01T08:30:30.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 843c7111-cbb0-4011-b968-d7312713c7d1 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3872024-11-01T08:30:30.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 843c7111-cbb0-4011-b968-d7312713c7d1 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3882024-11-01T08:30:30.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 843c7111-cbb0-4011-b968-d7312713c7d1 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3892024-11-01T08:30:31.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d5dbd543-e0d9-4293-9552-996fdca036a6 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3902024-11-01T08:30:31.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d5dbd543-e0d9-4293-9552-996fdca036a6 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3912024-11-01T08:30:31.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d5dbd543-e0d9-4293-9552-996fdca036a6 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3922024-11-01T08:30:32.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 198687ab-f6ec-4207-ab96-77267924a834 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3932024-11-01T08:30:32.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 198687ab-f6ec-4207-ab96-77267924a834 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3942024-11-01T08:30:32.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 198687ab-f6ec-4207-ab96-77267924a834 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3952024-11-01T08:30:33.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 687a4313-63b0-4741-a8d3-d2e2e9a8e29a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3962024-11-01T08:30:33.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 687a4313-63b0-4741-a8d3-d2e2e9a8e29a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3972024-11-01T08:30:33.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 687a4313-63b0-4741-a8d3-d2e2e9a8e29a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
3982024-11-01T08:30:34.697ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
3992024-11-01T08:30:34.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4002024-11-01T08:30:34.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4012024-11-01T08:30:34.698ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
4022024-11-01T08:30:34.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4032024-11-01T08:30:34.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4042024-11-01T08:30:34.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4052024-11-01T08:30:34.700ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4062024-11-01T08:30:34.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4072024-11-01T08:30:34.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4082024-11-01T08:30:34.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4092024-11-01T08:30:34.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4102024-11-01T08:30:34.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4112024-11-01T08:30:34.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4122024-11-01T08:30:34.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4132024-11-01T08:30:34.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
4142024-11-01T08:30:34.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4152024-11-01T08:30:34.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4162024-11-01T08:30:34.721ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
4172024-11-01T08:30:34.721ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.725748ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
4182024-11-01T08:30:34.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.132025ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4192024-11-01T08:30:34.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0f1d3567-1df3-428d-81aa-6f9fd7743b9c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4202024-11-01T08:30:34.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0f1d3567-1df3-428d-81aa-6f9fd7743b9c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4212024-11-01T08:30:34.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0f1d3567-1df3-428d-81aa-6f9fd7743b9c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4222024-11-01T08:30:35.201ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1472 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 1b451566-c996-46a4-8f64-d0ed40a6eb7c response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
4232024-11-01T08:30:35.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 322e929e-b00a-4e00-a4ed-2d3c05e6f5f5 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4242024-11-01T08:30:35.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 322e929e-b00a-4e00-a4ed-2d3c05e6f5f5 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4252024-11-01T08:30:35.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 322e929e-b00a-4e00-a4ed-2d3c05e6f5f5 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4262024-11-01T08:30:36.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8ba545fc-6411-4b7d-ab53-08147be917a4 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4272024-11-01T08:30:36.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8ba545fc-6411-4b7d-ab53-08147be917a4 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4282024-11-01T08:30:36.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8ba545fc-6411-4b7d-ab53-08147be917a4 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4292024-11-01T08:30:37.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a4b4e7a8-4760-4976-b961-387972e4cd9f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4302024-11-01T08:30:37.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a4b4e7a8-4760-4976-b961-387972e4cd9f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4312024-11-01T08:30:37.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a4b4e7a8-4760-4976-b961-387972e4cd9f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4322024-11-01T08:30:38.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e36d8bb3-ea28-4115-ad7f-7744aaf1d610 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4332024-11-01T08:30:38.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e36d8bb3-ea28-4115-ad7f-7744aaf1d610 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4342024-11-01T08:30:38.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e36d8bb3-ea28-4115-ad7f-7744aaf1d610 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4352024-11-01T08:30:39.624ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
4362024-11-01T08:30:39.624ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
4372024-11-01T08:30:39.655ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4382024-11-01T08:30:39.655ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60237
4392024-11-01T08:30:39.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60237 req_id = 77c4a229-be2c-44de-9575-b65ba7ee7bbe roles = RoleSet { roles: {} } uri = /metrics/producers
4402024-11-01T08:30:39.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60237 req_id = 77c4a229-be2c-44de-9575-b65ba7ee7bbe resource = Database result = Ok(()) uri = /metrics/producers
4412024-11-01T08:30:39.692ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
4422024-11-01T08:30:39.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37350 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60237 req_id = 77c4a229-be2c-44de-9575-b65ba7ee7bbe response_code = 201 uri = /metrics/producers
4432024-11-01T08:30:39.692ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "77c4a229-be2c-44de-9575-b65ba7ee7bbe", "content-length": "41", "date": "Fri, 01 Nov 2024 08:30:38 GMT"} })
4442024-11-01T08:30:39.693ZDEBGnexus (producer-registration-task): registered with nexus successfully
4452024-11-01T08:30:39.693ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
4462024-11-01T08:30:39.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e3fb3e16-4f4a-4dc0-92f3-ffa3bb2072fc roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4472024-11-01T08:30:39.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e3fb3e16-4f4a-4dc0-92f3-ffa3bb2072fc resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4482024-11-01T08:30:39.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e3fb3e16-4f4a-4dc0-92f3-ffa3bb2072fc response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4492024-11-01T08:30:40.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d8d0bc3e-4ac4-4fc4-b611-b2b98cefb5c1 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4502024-11-01T08:30:40.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d8d0bc3e-4ac4-4fc4-b611-b2b98cefb5c1 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4512024-11-01T08:30:40.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d8d0bc3e-4ac4-4fc4-b611-b2b98cefb5c1 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4522024-11-01T08:30:41.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3c987eb0-89f9-4956-a2a3-1b1faaa64b41 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4532024-11-01T08:30:41.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3c987eb0-89f9-4956-a2a3-1b1faaa64b41 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4542024-11-01T08:30:41.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3c987eb0-89f9-4956-a2a3-1b1faaa64b41 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4552024-11-01T08:30:42.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8127d0d2-77c1-41b3-96a4-a4c247ccf6bb roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4562024-11-01T08:30:42.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8127d0d2-77c1-41b3-96a4-a4c247ccf6bb resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4572024-11-01T08:30:42.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8127d0d2-77c1-41b3-96a4-a4c247ccf6bb response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4582024-11-01T08:30:43.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4800a128-270a-41cc-89f4-9a2137287d53 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4592024-11-01T08:30:43.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4800a128-270a-41cc-89f4-9a2137287d53 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4602024-11-01T08:30:43.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2692 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4800a128-270a-41cc-89f4-9a2137287d53 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4612024-11-01T08:30:44.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
4622024-11-01T08:30:44.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4632024-11-01T08:30:44.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4642024-11-01T08:30:44.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
4652024-11-01T08:30:44.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4662024-11-01T08:30:44.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4672024-11-01T08:30:44.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4682024-11-01T08:30:44.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4692024-11-01T08:30:44.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4702024-11-01T08:30:44.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4712024-11-01T08:30:44.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4722024-11-01T08:30:44.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4732024-11-01T08:30:44.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4742024-11-01T08:30:44.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
4752024-11-01T08:30:44.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4762024-11-01T08:30:44.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4772024-11-01T08:30:44.718ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
4782024-11-01T08:30:44.718ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.094348ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
4792024-11-01T08:30:44.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4802024-11-01T08:30:44.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4812024-11-01T08:30:44.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.398891ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4822024-11-01T08:30:44.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7ed3a49e-dfc1-4d80-ac17-27c24cac2225 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4832024-11-01T08:30:44.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7ed3a49e-dfc1-4d80-ac17-27c24cac2225 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4842024-11-01T08:30:44.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7ed3a49e-dfc1-4d80-ac17-27c24cac2225 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4852024-11-01T08:30:46.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3126bd4f-6e89-4f54-acd4-b713d7ba44e0 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4862024-11-01T08:30:46.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3126bd4f-6e89-4f54-acd4-b713d7ba44e0 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4872024-11-01T08:30:46.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3126bd4f-6e89-4f54-acd4-b713d7ba44e0 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4882024-11-01T08:30:47.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e04b72ba-9199-47ab-a4f6-e82afe1bae30 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4892024-11-01T08:30:47.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e04b72ba-9199-47ab-a4f6-e82afe1bae30 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4902024-11-01T08:30:47.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e04b72ba-9199-47ab-a4f6-e82afe1bae30 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4912024-11-01T08:30:48.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6077ddae-cba8-43a5-b5ec-9e9a730dca77 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4922024-11-01T08:30:48.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6077ddae-cba8-43a5-b5ec-9e9a730dca77 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4932024-11-01T08:30:48.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6077ddae-cba8-43a5-b5ec-9e9a730dca77 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4942024-11-01T08:30:49.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dc98ffab-07da-4d21-be6b-9dc1f3af91db roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4952024-11-01T08:30:49.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dc98ffab-07da-4d21-be6b-9dc1f3af91db resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4962024-11-01T08:30:49.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dc98ffab-07da-4d21-be6b-9dc1f3af91db response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4972024-11-01T08:30:50.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a14c8512-bb59-4da4-ad00-e0571a3e2cb3 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4982024-11-01T08:30:50.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a14c8512-bb59-4da4-ad00-e0571a3e2cb3 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
4992024-11-01T08:30:50.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a14c8512-bb59-4da4-ad00-e0571a3e2cb3 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5002024-11-01T08:30:50.204ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1564 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = a3a10ce5-5c6e-43a7-93c6-e0a9f008bbd1 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
5012024-11-01T08:30:51.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 165cfb1f-ec3d-4d36-9c47-751903a7eaee roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5022024-11-01T08:30:51.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 165cfb1f-ec3d-4d36-9c47-751903a7eaee resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5032024-11-01T08:30:51.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 165cfb1f-ec3d-4d36-9c47-751903a7eaee response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5042024-11-01T08:30:52.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 44aa0092-cb68-4e2c-97d4-2c61ce9e372f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5052024-11-01T08:30:52.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 44aa0092-cb68-4e2c-97d4-2c61ce9e372f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5062024-11-01T08:30:52.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 44aa0092-cb68-4e2c-97d4-2c61ce9e372f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5072024-11-01T08:30:53.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2591ed62-0bb5-4551-a62f-789eacb6870b roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5082024-11-01T08:30:53.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2591ed62-0bb5-4551-a62f-789eacb6870b resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5092024-11-01T08:30:53.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2591ed62-0bb5-4551-a62f-789eacb6870b response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5102024-11-01T08:30:54.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4851e6e1-fcb3-497e-ad4a-f76b7220b1aa roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5112024-11-01T08:30:54.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4851e6e1-fcb3-497e-ad4a-f76b7220b1aa resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5122024-11-01T08:30:54.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4851e6e1-fcb3-497e-ad4a-f76b7220b1aa response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
5132024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
5142024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
5152024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5162024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5172024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
5182024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
5192024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
5202024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5212024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5222024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
5232024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
5242024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
5252024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5262024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
5272024-11-01T08:30:54.697ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 08:20:54.697742291 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
5282024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5292024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
5302024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
5312024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5322024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
5332024-11-01T08:30:54.697ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876
5342024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
5352024-11-01T08:30:54.697ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
5362024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.42\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876"}
5372024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
5382024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5392024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
5402024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
5412024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5422024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
5432024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5442024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5452024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
5462024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
5472024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
5482024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5492024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
5502024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5512024-11-01T08:30:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
5522024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5532024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
5542024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.901\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
5552024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
5562024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
5572024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5582024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
5592024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5602024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
5612024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.831\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
5622024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5632024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
5642024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
5652024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.14\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
5662024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
5672024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
5682024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.95\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
5692024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5702024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5712024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
5722024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5732024-11-01T08:30:54.698ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5742024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5752024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5762024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5772024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5782024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5792024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5802024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5812024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5822024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5832024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5842024-11-01T08:30:54.698ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7a6aafb-271b-4c58-a4ee-a120d4fe517b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5a9d05d-8509-4c10-96d8-97ac84fede0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5a9d05d-8509-4c10-96d8-97ac84fede0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 4819, tv_nsec: 542105972 } })
5852024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5862024-11-01T08:30:54.698ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4bab0cba-a00a-4740-88aa-0040e016028d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("726c5ac9-9d5f-4339-8159-0a04793fd959.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 4819, tv_nsec: 542114862 } })
5872024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5882024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5892024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5902024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5912024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5922024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5932024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5942024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5952024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5962024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5972024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
5982024-11-01T08:30:54.698ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.18374ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5992024-11-01T08:30:54.699ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
6002024-11-01T08:30:54.699ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.159678ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
6012024-11-01T08:30:54.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6022024-11-01T08:30:54.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6032024-11-01T08:30:54.700ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 08:20:54.697742291 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
6042024-11-01T08:30:54.700ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.961063ms iteration = 12 status = {"expiration":"2024-11-01T08:20:54.697742291Z","pruned":[]}
6052024-11-01T08:30:54.701ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4819, tv_nsec: 545517836 } })
6062024-11-01T08:30:54.702ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
6072024-11-01T08:30:54.702ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.691185ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6082024-11-01T08:30:54.702ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4819, tv_nsec: 546107030 } })
6092024-11-01T08:30:54.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6102024-11-01T08:30:54.702ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
6112024-11-01T08:30:54.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6122024-11-01T08:30:54.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6132024-11-01T08:30:54.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6142024-11-01T08:30:54.704ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.928941ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
6152024-11-01T08:30:54.705ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6162024-11-01T08:30:54.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6172024-11-01T08:30:54.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6182024-11-01T08:30:54.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6192024-11-01T08:30:54.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6202024-11-01T08:30:54.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6212024-11-01T08:30:54.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6222024-11-01T08:30:54.708ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6232024-11-01T08:30:54.708ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6242024-11-01T08:30:54.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6252024-11-01T08:30:54.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6262024-11-01T08:30:54.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6272024-11-01T08:30:54.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6282024-11-01T08:30:54.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6292024-11-01T08:30:54.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6302024-11-01T08:30:54.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6312024-11-01T08:30:54.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6322024-11-01T08:30:54.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6332024-11-01T08:30:54.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6342024-11-01T08:30:54.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6352024-11-01T08:30:54.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6362024-11-01T08:30:54.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6372024-11-01T08:30:54.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6382024-11-01T08:30:54.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6392024-11-01T08:30:54.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6402024-11-01T08:30:54.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4819, tv_nsec: 569589627 } })
6412024-11-01T08:30:54.726ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
6422024-11-01T08:30:54.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6432024-11-01T08:30:54.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6442024-11-01T08:30:54.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6452024-11-01T08:30:54.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462024-11-01T08:30:54.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6472024-11-01T08:30:54.737ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6482024-11-01T08:30:54.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6492024-11-01T08:30:54.739ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6502024-11-01T08:30:54.739ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 41.806397ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6512024-11-01T08:30:54.757ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6522024-11-01T08:30:54.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6532024-11-01T08:30:54.760ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6542024-11-01T08:30:54.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6552024-11-01T08:30:54.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6562024-11-01T08:30:54.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6572024-11-01T08:30:54.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6582024-11-01T08:30:54.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6592024-11-01T08:30:54.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6602024-11-01T08:30:54.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6612024-11-01T08:30:54.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6622024-11-01T08:30:54.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6632024-11-01T08:30:54.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6642024-11-01T08:30:54.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6652024-11-01T08:30:54.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6662024-11-01T08:30:54.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6672024-11-01T08:30:54.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6682024-11-01T08:30:54.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6692024-11-01T08:30:54.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6702024-11-01T08:30:54.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6712024-11-01T08:30:54.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6722024-11-01T08:30:54.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6732024-11-01T08:30:54.776ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6742024-11-01T08:30:54.776ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6752024-11-01T08:30:54.776ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6762024-11-01T08:30:54.776ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6772024-11-01T08:30:54.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6782024-11-01T08:30:54.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6792024-11-01T08:30:54.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6802024-11-01T08:30:54.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6812024-11-01T08:30:54.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6822024-11-01T08:30:54.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6832024-11-01T08:30:54.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6842024-11-01T08:30:54.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6852024-11-01T08:30:54.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
6862024-11-01T08:30:54.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6872024-11-01T08:30:54.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6882024-11-01T08:30:54.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6892024-11-01T08:30:54.781ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6902024-11-01T08:30:54.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6912024-11-01T08:30:54.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6922024-11-01T08:30:54.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6932024-11-01T08:30:54.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6942024-11-01T08:30:54.788ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6952024-11-01T08:30:54.789ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6962024-11-01T08:30:54.789ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.980176ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6972024-11-01T08:30:54.789ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6982024-11-01T08:30:54.789ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6992024-11-01T08:30:54.789ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7002024-11-01T08:30:54.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7012024-11-01T08:30:54.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7022024-11-01T08:30:54.790ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.979225ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7032024-11-01T08:30:54.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7042024-11-01T08:30:54.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7052024-11-01T08:30:54.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7062024-11-01T08:30:54.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7072024-11-01T08:30:54.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7082024-11-01T08:30:54.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7092024-11-01T08:30:54.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7102024-11-01T08:30:54.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7112024-11-01T08:30:54.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f7fe3bf0-db6a-428d-8129-f334aa61483d, lookup_type: ById(f7fe3bf0-db6a-428d-8129-f334aa61483d) } result = Ok(())
7122024-11-01T08:30:54.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7132024-11-01T08:30:54.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7142024-11-01T08:30:54.799ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.639617ms iteration = 23 status = 0
7152024-11-01T08:30:54.799ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7162024-11-01T08:30:54.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7172024-11-01T08:30:54.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182024-11-01T08:30:54.811ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
7192024-11-01T08:30:54.811ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.081493ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
7202024-11-01T08:30:54.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7212024-11-01T08:30:54.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7222024-11-01T08:30:54.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7232024-11-01T08:30:54.822ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7242024-11-01T08:30:54.822ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
7252024-11-01T08:30:54.822ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.89716ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7262024-11-01T08:30:54.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 135.300035ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7272024-11-01T08:30:54.835ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7282024-11-01T08:30:54.835ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1a6211e1-bd03-4044-93cd-6a5868005875 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7292024-11-01T08:30:54.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7302024-11-01T08:30:54.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7312024-11-01T08:30:54.838ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
7322024-11-01T08:30:54.838ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
7332024-11-01T08:30:54.838ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
7342024-11-01T08:30:54.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7352024-11-01T08:30:54.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7362024-11-01T08:30:54.840ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7372024-11-01T08:30:54.840ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7382024-11-01T08:30:54.840ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.086842ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7392024-11-01T08:30:54.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7402024-11-01T08:30:54.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7412024-11-01T08:30:54.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7422024-11-01T08:30:54.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7432024-11-01T08:30:54.847ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7442024-11-01T08:30:54.847ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b06c736-f13d-44f4-95f3-1c25c945a356 dns_zone_name = oxide.test found_so_far = 0 version = 2
7452024-11-01T08:30:54.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7462024-11-01T08:30:54.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7472024-11-01T08:30:54.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7482024-11-01T08:30:54.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7492024-11-01T08:30:54.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7502024-11-01T08:30:54.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7512024-11-01T08:30:54.856ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b06c736-f13d-44f4-95f3-1c25c945a356 dns_zone_name = oxide.test found_so_far = 1 version = 2
7522024-11-01T08:30:54.856ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7532024-11-01T08:30:54.856ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 08:20:37.945638 UTC dns_group = external generation = 2
7542024-11-01T08:30:54.856ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 158.70853ms iteration = 13 status = {"generation":2}
7552024-11-01T08:30:54.865ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7562024-11-01T08:30:54.866ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7572024-11-01T08:30:54.867ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 169.009534ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7582024-11-01T08:30:54.867ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T08:19:51.214273Z, time_modified: 2024-11-01T08:19:51.214273Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f8c93fa7-6555-4906-9ff7-39adb002e287, db_silo: Silo { identity: SiloIdentity { id: f8c93fa7-6555-4906-9ff7-39adb002e287, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T08:20:37.795553Z, time_modified: 2024-11-01T08:20:37.795553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f8c93fa7-6555-4906-9ff7-39adb002e287, db_silo: Silo { identity: SiloIdentity { id: f8c93fa7-6555-4906-9ff7-39adb002e287, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T08:20:37.795553Z, time_modified: 2024-11-01T08:20:37.795553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372" }] }) }
7592024-11-01T08:30:54.867ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7602024-11-01T08:30:54.867ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 169.157207ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f8c93fa7-6555-4906-9ff7-39adb002e287","tls_certs":["03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372"]}},"default_endpoint":{"silo_id":"f8c93fa7-6555-4906-9ff7-39adb002e287","tls_certs":["03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7612024-11-01T08:30:54.867ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7622024-11-01T08:30:54.867ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b70429b-9ad9-4827-8435-20743269f0e7", "content-length": "26", "date": "Fri, 01 Nov 2024 08:30:54 GMT"} })
7632024-11-01T08:30:54.867ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7642024-11-01T08:30:54.869ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7652024-11-01T08:30:54.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7662024-11-01T08:30:54.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7672024-11-01T08:30:54.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7682024-11-01T08:30:54.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7692024-11-01T08:30:54.880ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1a6211e1-bd03-4044-93cd-6a5868005875 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7702024-11-01T08:30:54.880ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7712024-11-01T08:30:54.880ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 08:20:37.196977 UTC dns_group = internal generation = 1
7722024-11-01T08:30:54.880ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 183.306755ms iteration = 13 status = {"generation":1}
7732024-11-01T08:30:54.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7742024-11-01T08:30:54.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7752024-11-01T08:30:54.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7762024-11-01T08:30:54.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7772024-11-01T08:30:54.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7782024-11-01T08:30:54.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7792024-11-01T08:30:54.892ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7802024-11-01T08:30:54.892ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7812024-11-01T08:30:54.892ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a8ec18e-2a96-432c-b7ab-219ee4cd75ac", "content-length": "26", "date": "Fri, 01 Nov 2024 08:30:54 GMT"} })
7822024-11-01T08:30:54.892ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7832024-11-01T08:30:54.894ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7842024-11-01T08:30:54.915ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 217.197228ms iteration = 27 status = {"physical_disks_added":0}
7852024-11-01T08:30:54.958ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7862024-11-01T08:30:55.044ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 zone_address = fd00:1122:3344:101::2
7872024-11-01T08:30:55.044ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7882024-11-01T08:30:55.045ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a82afeb1-b916-40e0-9057-40c9e98394a8", "content-length": "26", "date": "Fri, 01 Nov 2024 08:30:54 GMT"} })
7892024-11-01T08:30:55.045ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7902024-11-01T08:30:55.047ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
7912024-11-01T08:30:55.085ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 387.628577ms iteration = 23 status = {}
7922024-11-01T08:30:55.093ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7932024-11-01T08:30:55.093ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7942024-11-01T08:30:55.094ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ace0decb-a239-4adc-bb65-3c021f0c522a", "content-length": "372", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} })
7952024-11-01T08:30:55.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7962024-11-01T08:30:55.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7972024-11-01T08:30:55.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7982024-11-01T08:30:55.097ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7992024-11-01T08:30:55.097ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8002024-11-01T08:30:55.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8012024-11-01T08:30:55.120ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8022024-11-01T08:30:55.120ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8032024-11-01T08:30:55.120ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d924afaa-62df-4c56-9778-8bbd4ee765dd", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} })
8042024-11-01T08:30:55.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8052024-11-01T08:30:55.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8062024-11-01T08:30:55.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8072024-11-01T08:30:55.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8082024-11-01T08:30:55.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8092024-11-01T08:30:55.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8102024-11-01T08:30:55.131ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8112024-11-01T08:30:55.131ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8122024-11-01T08:30:55.131ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9ce37b69-3f1a-4ae5-8a09-fcf3c29f0f45", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} })
8132024-11-01T08:30:55.133ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 435.708748ms iteration = 24 status = {}
8142024-11-01T08:30:55.150ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
8152024-11-01T08:30:55.180ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
8162024-11-01T08:30:55.180ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ef425f20-65c5-4b61-8d68-e67bd209cc51", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8172024-11-01T08:30:55.180ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8182024-11-01T08:30:55.181ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8192024-11-01T08:30:55.181ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "64f03dd5-236f-407a-9445-c0535c118212", "content-length": "1", "date": "Fri, 01 Nov 2024 08:30:54 GMT"} })
8202024-11-01T08:30:55.181ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "608b1bb2-6d33-4087-9495-5a4e4b80edb5", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8212024-11-01T08:30:55.181ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8222024-11-01T08:30:55.184ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8232024-11-01T08:30:55.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8242024-11-01T08:30:55.184ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8252024-11-01T08:30:55.184ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 486.997428ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
8262024-11-01T08:30:55.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 21b696f0-a987-41c7-bfa8-f84a24a8a997 roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
8272024-11-01T08:30:55.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 21b696f0-a987-41c7-bfa8-f84a24a8a997 resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
8282024-11-01T08:30:55.224ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8292024-11-01T08:30:55.227ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 529.535574ms iteration = 23 status = null
8302024-11-01T08:30:55.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 21b696f0-a987-41c7-bfa8-f84a24a8a997 response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
8312024-11-01T08:30:55.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 1a6df034-e4ef-45c0-afa2-dc246a635bbd roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
8322024-11-01T08:30:55.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 1a6df034-e4ef-45c0-afa2-dc246a635bbd resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
8332024-11-01T08:30:55.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 1a6df034-e4ef-45c0-afa2-dc246a635bbd response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
8342024-11-01T08:30:55.241ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
8352024-11-01T08:30:55.242ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4582b0c8-0f1a-4f15-8931-27430429c3eb", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
8362024-11-01T08:30:55.242ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
8372024-11-01T08:30:55.243ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6f3addfc-c76f-4e97-898f-409bddaed897", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
8382024-11-01T08:30:55.243ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
8392024-11-01T08:30:55.245ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4fb69c05-07fa-496f-bdc6-91b1b0498808", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
8402024-11-01T08:30:55.245ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
8412024-11-01T08:30:55.247ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
8422024-11-01T08:30:55.247ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 550.11177ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8432024-11-01T08:30:55.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8442024-11-01T08:30:55.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8452024-11-01T08:30:55.295ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e2aedfd9-3b4d-40ab-920a-0ddf803678fe, rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a0c3e848-f136-4ae5-b986-95beae550c75) } rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
8462024-11-01T08:30:55.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8472024-11-01T08:30:55.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8482024-11-01T08:30:55.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0911667a-04b3-470b-9def-1adc7fa26449 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
8492024-11-01T08:30:55.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0911667a-04b3-470b-9def-1adc7fa26449 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
8502024-11-01T08:30:55.297ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "211994fb-5dd4-4637-b331-3b84e9d3ce06", "content-length": "691", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} })
8512024-11-01T08:30:55.297ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8522024-11-01T08:30:55.297ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8532024-11-01T08:30:55.297ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8542024-11-01T08:30:55.299ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 601.701428ms iteration = 23 status = {}
8552024-11-01T08:30:55.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0911667a-04b3-470b-9def-1adc7fa26449 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
8562024-11-01T08:30:55.304ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8572024-11-01T08:30:55.304ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c86256f-7423-46c7-802b-af8350707a83", "content-length": "121", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} })
8582024-11-01T08:30:55.304ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
8592024-11-01T08:30:55.304ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a0c3e848-f136-4ae5-b986-95beae550c75
8602024-11-01T08:30:55.305ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8612024-11-01T08:30:55.305ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8622024-11-01T08:30:55.305ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8632024-11-01T08:30:55.305ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8642024-11-01T08:30:55.305ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8652024-11-01T08:30:55.305ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8662024-11-01T08:30:55.305ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8672024-11-01T08:30:55.305ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8682024-11-01T08:30:55.305ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
8692024-11-01T08:30:55.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8702024-11-01T08:30:55.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8712024-11-01T08:30:55.307ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8722024-11-01T08:30:55.308ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "12084a96-5332-45a2-88cb-90bdddc9b0ea", "content-length": "2", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} })
8732024-11-01T08:30:55.308ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8742024-11-01T08:30:55.308ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a37c7365-4e9d-4a0e-91a9-683187c73de3", "content-length": "52", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} })
8752024-11-01T08:30:55.308ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
8762024-11-01T08:30:55.308ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8772024-11-01T08:30:55.411ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e748c764-12c3-4886-93a3-b442c9d6f8ec", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} })
8782024-11-01T08:30:55.411ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch = Switch0
8792024-11-01T08:30:55.411ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8802024-11-01T08:30:55.411ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7db352b-3c38-47b9-b15b-410270d6b894", "content-length": "669", "date": "Fri, 01 Nov 2024 08:30:55 GMT"} })
8812024-11-01T08:30:55.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8822024-11-01T08:30:55.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8832024-11-01T08:30:55.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8842024-11-01T08:30:55.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8852024-11-01T08:30:55.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8862024-11-01T08:30:55.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8872024-11-01T08:30:55.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8882024-11-01T08:30:55.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8892024-11-01T08:30:55.430ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 732.567534ms iteration = 23 status = {}
8902024-11-01T08:30:55.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = f3dd22e4-22ae-418f-bb3b-787530e398f0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8912024-11-01T08:30:55.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = f3dd22e4-22ae-418f-bb3b-787530e398f0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8922024-11-01T08:30:55.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = f3dd22e4-22ae-418f-bb3b-787530e398f0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8932024-11-01T08:30:56.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 44947225-b6f2-4102-a854-87e8ca972880 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
8942024-11-01T08:30:56.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 44947225-b6f2-4102-a854-87e8ca972880 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
8952024-11-01T08:30:56.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 44947225-b6f2-4102-a854-87e8ca972880 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
8962024-11-01T08:30:57.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 49872263-e7e8-415f-9165-6878fefbdac0 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
8972024-11-01T08:30:57.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 49872263-e7e8-415f-9165-6878fefbdac0 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
8982024-11-01T08:30:57.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 49872263-e7e8-415f-9165-6878fefbdac0 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
8992024-11-01T08:30:58.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ced5173b-c9d3-4901-879b-9cc57da5bc8f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9002024-11-01T08:30:58.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ced5173b-c9d3-4901-879b-9cc57da5bc8f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9012024-11-01T08:30:58.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ced5173b-c9d3-4901-879b-9cc57da5bc8f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9022024-11-01T08:30:59.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7085f345-6921-4945-bf06-5cd71ca41b5e roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9032024-11-01T08:30:59.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7085f345-6921-4945-bf06-5cd71ca41b5e resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9042024-11-01T08:30:59.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7085f345-6921-4945-bf06-5cd71ca41b5e response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9052024-11-01T08:31:00.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = acbfc2c8-4c5d-408f-acaf-12c4f4b2bad9 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9062024-11-01T08:31:00.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = acbfc2c8-4c5d-408f-acaf-12c4f4b2bad9 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9072024-11-01T08:31:00.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = acbfc2c8-4c5d-408f-acaf-12c4f4b2bad9 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9082024-11-01T08:31:01.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3fa6b671-cd92-4418-b33e-d3e400f661d8 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9092024-11-01T08:31:01.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3fa6b671-cd92-4418-b33e-d3e400f661d8 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9102024-11-01T08:31:01.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3fa6b671-cd92-4418-b33e-d3e400f661d8 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9112024-11-01T08:31:02.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0187cbd5-529a-4915-9eae-66ab41c0c161 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9122024-11-01T08:31:02.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0187cbd5-529a-4915-9eae-66ab41c0c161 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9132024-11-01T08:31:02.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0187cbd5-529a-4915-9eae-66ab41c0c161 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9142024-11-01T08:31:03.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 61a478d8-1c50-41a8-bad9-1d635b0b765b roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9152024-11-01T08:31:03.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 61a478d8-1c50-41a8-bad9-1d635b0b765b resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9162024-11-01T08:31:03.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 61a478d8-1c50-41a8-bad9-1d635b0b765b response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9172024-11-01T08:31:04.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 16024e18-4a8e-4e6e-8c97-5a806afa7928 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9182024-11-01T08:31:04.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 16024e18-4a8e-4e6e-8c97-5a806afa7928 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9192024-11-01T08:31:04.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 16024e18-4a8e-4e6e-8c97-5a806afa7928 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9202024-11-01T08:31:04.697ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
9212024-11-01T08:31:04.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9222024-11-01T08:31:04.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9232024-11-01T08:31:04.698ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
9242024-11-01T08:31:04.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9252024-11-01T08:31:04.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9262024-11-01T08:31:04.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9272024-11-01T08:31:04.700ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9282024-11-01T08:31:04.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9292024-11-01T08:31:04.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.517736ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9302024-11-01T08:31:04.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9312024-11-01T08:31:04.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9322024-11-01T08:31:04.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9332024-11-01T08:31:04.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9342024-11-01T08:31:04.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9352024-11-01T08:31:04.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9362024-11-01T08:31:04.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
9372024-11-01T08:31:04.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9382024-11-01T08:31:04.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9392024-11-01T08:31:04.716ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
9402024-11-01T08:31:04.716ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.420447ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
9412024-11-01T08:31:05.232ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1323 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = c1eb5492-964c-44c0-963d-574dc9f1274f response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
9422024-11-01T08:31:05.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3737c953-caae-4fb0-83b2-fc9c1e89da73 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9432024-11-01T08:31:05.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3737c953-caae-4fb0-83b2-fc9c1e89da73 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9442024-11-01T08:31:05.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3737c953-caae-4fb0-83b2-fc9c1e89da73 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9452024-11-01T08:31:06.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0fc1a0e4-cefb-4b2e-8994-ce852d2b9acc roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9462024-11-01T08:31:06.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0fc1a0e4-cefb-4b2e-8994-ce852d2b9acc resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9472024-11-01T08:31:06.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0fc1a0e4-cefb-4b2e-8994-ce852d2b9acc response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9482024-11-01T08:31:07.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 53b4e308-aa8c-441c-bbae-32a120bbc01c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9492024-11-01T08:31:07.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 53b4e308-aa8c-441c-bbae-32a120bbc01c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9502024-11-01T08:31:07.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 53b4e308-aa8c-441c-bbae-32a120bbc01c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9512024-11-01T08:31:08.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 95115d0f-27df-4126-9a14-fcff91558c0b roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9522024-11-01T08:31:08.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 95115d0f-27df-4126-9a14-fcff91558c0b resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9532024-11-01T08:31:08.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 95115d0f-27df-4126-9a14-fcff91558c0b response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9542024-11-01T08:31:09.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5c57e739-bc79-4fb5-9452-4f45f9f4ce77 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9552024-11-01T08:31:09.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5c57e739-bc79-4fb5-9452-4f45f9f4ce77 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9562024-11-01T08:31:09.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5c57e739-bc79-4fb5-9452-4f45f9f4ce77 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9572024-11-01T08:31:10.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 40dd8ab6-0b70-4a28-a1d1-24ac10077712 roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
9582024-11-01T08:31:10.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 40dd8ab6-0b70-4a28-a1d1-24ac10077712 resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
9592024-11-01T08:31:10.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 40dd8ab6-0b70-4a28-a1d1-24ac10077712 response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
9602024-11-01T08:31:10.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = fbb8e328-31e5-453a-b9b4-6b7c4ddb63fa roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
9612024-11-01T08:31:10.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = fbb8e328-31e5-453a-b9b4-6b7c4ddb63fa resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
9622024-11-01T08:31:10.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = fbb8e328-31e5-453a-b9b4-6b7c4ddb63fa response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
9632024-11-01T08:31:10.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 83388a5e-fb0c-48bd-a5ec-9bfbe5e08a9f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9642024-11-01T08:31:10.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 83388a5e-fb0c-48bd-a5ec-9bfbe5e08a9f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9652024-11-01T08:31:10.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 83388a5e-fb0c-48bd-a5ec-9bfbe5e08a9f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9662024-11-01T08:31:11.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b4e6bad4-bdde-46ac-9e98-91cf808994f8 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9672024-11-01T08:31:11.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b4e6bad4-bdde-46ac-9e98-91cf808994f8 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9682024-11-01T08:31:11.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b4e6bad4-bdde-46ac-9e98-91cf808994f8 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9692024-11-01T08:31:12.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2bcfb1fd-dd54-44cd-97ac-2ba061fdb880 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9702024-11-01T08:31:12.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2bcfb1fd-dd54-44cd-97ac-2ba061fdb880 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9712024-11-01T08:31:12.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2bcfb1fd-dd54-44cd-97ac-2ba061fdb880 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9722024-11-01T08:31:13.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 092b9756-4afc-4276-8bc8-d6c062197b4f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9732024-11-01T08:31:13.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 092b9756-4afc-4276-8bc8-d6c062197b4f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9742024-11-01T08:31:13.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 092b9756-4afc-4276-8bc8-d6c062197b4f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9752024-11-01T08:31:14.697ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
9762024-11-01T08:31:14.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9772024-11-01T08:31:14.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9782024-11-01T08:31:14.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
9792024-11-01T08:31:14.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9802024-11-01T08:31:14.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9812024-11-01T08:31:14.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9822024-11-01T08:31:14.699ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9832024-11-01T08:31:14.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9842024-11-01T08:31:14.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9852024-11-01T08:31:14.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9862024-11-01T08:31:14.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9872024-11-01T08:31:14.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9882024-11-01T08:31:14.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9892024-11-01T08:31:14.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9902024-11-01T08:31:14.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
9912024-11-01T08:31:14.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9922024-11-01T08:31:14.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9932024-11-01T08:31:14.718ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
9942024-11-01T08:31:14.718ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.246352ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
9952024-11-01T08:31:14.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.103112ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9962024-11-01T08:31:14.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fb2d213e-65a6-4c58-b7b5-ddb00268ee4d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9972024-11-01T08:31:14.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fb2d213e-65a6-4c58-b7b5-ddb00268ee4d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9982024-11-01T08:31:14.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fb2d213e-65a6-4c58-b7b5-ddb00268ee4d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
9992024-11-01T08:31:15.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0cda1fbd-63b2-401c-b27c-9b7942c95e0e roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10002024-11-01T08:31:15.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0cda1fbd-63b2-401c-b27c-9b7942c95e0e resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10012024-11-01T08:31:15.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0cda1fbd-63b2-401c-b27c-9b7942c95e0e response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10022024-11-01T08:31:16.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1634e1f6-77f4-4770-9fd1-9d931c4e6898 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10032024-11-01T08:31:16.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1634e1f6-77f4-4770-9fd1-9d931c4e6898 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10042024-11-01T08:31:16.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1634e1f6-77f4-4770-9fd1-9d931c4e6898 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10052024-11-01T08:31:17.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3a5c7605-7b3b-4845-8448-292b7dfff72f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10062024-11-01T08:31:17.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3a5c7605-7b3b-4845-8448-292b7dfff72f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10072024-11-01T08:31:17.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3a5c7605-7b3b-4845-8448-292b7dfff72f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10082024-11-01T08:31:18.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cd59eb9e-59d7-4223-a96c-f8625fc28be4 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10092024-11-01T08:31:18.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cd59eb9e-59d7-4223-a96c-f8625fc28be4 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10102024-11-01T08:31:18.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cd59eb9e-59d7-4223-a96c-f8625fc28be4 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10112024-11-01T08:31:19.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c3ea6c75-f3bf-468d-9047-969bff0c6a10 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10122024-11-01T08:31:19.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c3ea6c75-f3bf-468d-9047-969bff0c6a10 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10132024-11-01T08:31:19.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c3ea6c75-f3bf-468d-9047-969bff0c6a10 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10142024-11-01T08:31:20.203ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1497 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = cdf18896-b12f-4500-9139-58e0d5610f36 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
10152024-11-01T08:31:20.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = aaa47d11-c04e-4055-8e6b-4da731af397f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10162024-11-01T08:31:20.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = aaa47d11-c04e-4055-8e6b-4da731af397f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10172024-11-01T08:31:20.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = aaa47d11-c04e-4055-8e6b-4da731af397f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10182024-11-01T08:31:22.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 318c8cfb-bacf-4d81-a821-72d988088a2a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10192024-11-01T08:31:22.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 318c8cfb-bacf-4d81-a821-72d988088a2a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10202024-11-01T08:31:22.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 318c8cfb-bacf-4d81-a821-72d988088a2a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10212024-11-01T08:31:23.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1dbcda27-14e2-4644-96f4-5085e4d55b75 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10222024-11-01T08:31:23.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1dbcda27-14e2-4644-96f4-5085e4d55b75 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10232024-11-01T08:31:23.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1dbcda27-14e2-4644-96f4-5085e4d55b75 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10242024-11-01T08:31:24.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fb0cc88b-19f5-40f0-ad40-6c3ce3e55496 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10252024-11-01T08:31:24.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fb0cc88b-19f5-40f0-ad40-6c3ce3e55496 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10262024-11-01T08:31:24.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fb0cc88b-19f5-40f0-ad40-6c3ce3e55496 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
10272024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
10282024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
10292024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
10302024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10312024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10322024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10332024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
10342024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
10352024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10362024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10372024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
10382024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
10392024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10402024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
10412024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10422024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
10432024-11-01T08:31:24.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10442024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10452024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10462024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10472024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10482024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10492024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10502024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10512024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10522024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
10532024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
10542024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
10552024-11-01T08:31:24.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
10562024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.03\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
10572024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.9\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
10582024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10592024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
10602024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
10612024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.18\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10622024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10632024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
10642024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.65\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10652024-11-01T08:31:24.698ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10662024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10672024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10682024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
10692024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10702024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10712024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10722024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10732024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10742024-11-01T08:31:24.698ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10752024-11-01T08:31:24.699ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4849, tv_nsec: 543760981 } })
10762024-11-01T08:31:24.700ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
10772024-11-01T08:31:24.700ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10782024-11-01T08:31:24.700ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.104791ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10792024-11-01T08:31:24.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10802024-11-01T08:31:24.701ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10812024-11-01T08:31:24.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10822024-11-01T08:31:24.701ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10832024-11-01T08:31:24.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10842024-11-01T08:31:24.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852024-11-01T08:31:24.703ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4849, tv_nsec: 547090803 } })
10862024-11-01T08:31:24.703ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
10872024-11-01T08:31:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10882024-11-01T08:31:24.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10892024-11-01T08:31:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10902024-11-01T08:31:24.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10912024-11-01T08:31:24.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10922024-11-01T08:31:24.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10932024-11-01T08:31:24.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10942024-11-01T08:31:24.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10952024-11-01T08:31:24.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10962024-11-01T08:31:24.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10972024-11-01T08:31:24.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10982024-11-01T08:31:24.707ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10992024-11-01T08:31:24.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11002024-11-01T08:31:24.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11012024-11-01T08:31:24.708ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11022024-11-01T08:31:24.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11032024-11-01T08:31:24.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11042024-11-01T08:31:24.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11052024-11-01T08:31:24.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11062024-11-01T08:31:24.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11072024-11-01T08:31:24.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11082024-11-01T08:31:24.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11092024-11-01T08:31:24.711ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4849, tv_nsec: 555535411 } })
11102024-11-01T08:31:24.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11112024-11-01T08:31:24.712ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
11122024-11-01T08:31:24.712ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11132024-11-01T08:31:24.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11142024-11-01T08:31:24.715ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11152024-11-01T08:31:24.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11162024-11-01T08:31:24.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11172024-11-01T08:31:24.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11182024-11-01T08:31:24.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11192024-11-01T08:31:24.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11202024-11-01T08:31:24.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
11212024-11-01T08:31:24.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11222024-11-01T08:31:24.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11232024-11-01T08:31:24.751ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
11242024-11-01T08:31:24.751ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.020112ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
11252024-11-01T08:31:24.752ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11262024-11-01T08:31:24.752ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11272024-11-01T08:31:24.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11282024-11-01T08:31:24.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11292024-11-01T08:31:24.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11302024-11-01T08:31:24.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11312024-11-01T08:31:24.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11322024-11-01T08:31:24.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11332024-11-01T08:31:24.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11342024-11-01T08:31:24.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11352024-11-01T08:31:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11362024-11-01T08:31:24.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11372024-11-01T08:31:24.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11382024-11-01T08:31:24.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.542215ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11392024-11-01T08:31:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f7fe3bf0-db6a-428d-8129-f334aa61483d, lookup_type: ById(f7fe3bf0-db6a-428d-8129-f334aa61483d) } result = Ok(())
11402024-11-01T08:31:24.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11412024-11-01T08:31:24.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11422024-11-01T08:31:24.767ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.215605ms iteration = 24 status = 0
11432024-11-01T08:31:24.767ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 70.680567ms iteration = 28 status = {"physical_disks_added":0}
11442024-11-01T08:31:24.773ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.227209ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11452024-11-01T08:31:24.777ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11462024-11-01T08:31:24.777ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.74336ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11472024-11-01T08:31:24.796ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11482024-11-01T08:31:24.796ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11492024-11-01T08:31:24.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11502024-11-01T08:31:24.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11512024-11-01T08:31:24.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11522024-11-01T08:31:24.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11532024-11-01T08:31:24.803ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
11542024-11-01T08:31:24.803ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11552024-11-01T08:31:24.803ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8a14d2c-36e7-453d-b919-3081d98810b7", "content-length": "26", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
11562024-11-01T08:31:24.803ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11572024-11-01T08:31:24.806ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11582024-11-01T08:31:24.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11592024-11-01T08:31:24.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11602024-11-01T08:31:24.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11612024-11-01T08:31:24.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11622024-11-01T08:31:24.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11632024-11-01T08:31:24.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11642024-11-01T08:31:24.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652024-11-01T08:31:24.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11662024-11-01T08:31:24.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11672024-11-01T08:31:24.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11682024-11-01T08:31:24.826ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11692024-11-01T08:31:24.826ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11702024-11-01T08:31:24.826ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.17647ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11712024-11-01T08:31:24.903ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
11722024-11-01T08:31:24.903ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11732024-11-01T08:31:24.903ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82e10ab6-1b86-49b0-a36e-9e06063066b2", "content-length": "26", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
11742024-11-01T08:31:24.903ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11752024-11-01T08:31:24.906ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11762024-11-01T08:31:24.959ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 zone_address = fd00:1122:3344:101::2
11772024-11-01T08:31:24.959ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11782024-11-01T08:31:24.959ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0889c198-b0ae-41cf-91e0-97f723c715df", "content-length": "26", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
11792024-11-01T08:31:24.959ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11802024-11-01T08:31:24.961ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
11812024-11-01T08:31:24.971ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11822024-11-01T08:31:24.971ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11832024-11-01T08:31:24.971ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab626b21-7d39-4b49-b6f4-7c7a72c177c6", "content-length": "372", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
11842024-11-01T08:31:24.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11852024-11-01T08:31:24.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11862024-11-01T08:31:24.991ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11872024-11-01T08:31:24.991ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11882024-11-01T08:31:24.991ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "387488c4-97b8-4a60-914c-9f2346b9726c", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
11892024-11-01T08:31:24.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11902024-11-01T08:31:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11912024-11-01T08:31:24.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11922024-11-01T08:31:24.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11932024-11-01T08:31:24.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11942024-11-01T08:31:24.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11952024-11-01T08:31:25.038ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11962024-11-01T08:31:25.039ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "447a5c9f-092a-4408-ba3e-55d2e9a31a36", "content-length": "1", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
11972024-11-01T08:31:25.040ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11982024-11-01T08:31:25.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11992024-11-01T08:31:25.043ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12002024-11-01T08:31:25.043ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d67bcd6c-a4c6-435e-8483-36ecb62a0aa1", "content-length": "691", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
12012024-11-01T08:31:25.043ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12022024-11-01T08:31:25.043ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12032024-11-01T08:31:25.043ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12042024-11-01T08:31:25.045ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 348.274319ms iteration = 24 status = {}
12052024-11-01T08:31:25.045ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 348.958196ms iteration = 24 status = null
12062024-11-01T08:31:25.048ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12072024-11-01T08:31:25.048ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12082024-11-01T08:31:25.049ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d82c9076-885e-4a1c-953c-aa7c31376e68", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
12092024-11-01T08:31:25.051ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 353.339273ms iteration = 25 status = {}
12102024-11-01T08:31:25.064ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 367.392069ms iteration = 24 status = {}
12112024-11-01T08:31:25.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12122024-11-01T08:31:25.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12132024-11-01T08:31:25.127ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e2aedfd9-3b4d-40ab-920a-0ddf803678fe, rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a0c3e848-f136-4ae5-b986-95beae550c75) } rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
12142024-11-01T08:31:25.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12152024-11-01T08:31:25.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12162024-11-01T08:31:25.137ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12172024-11-01T08:31:25.137ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed006e44-0055-421d-8c0c-d5a3327606f0", "content-length": "121", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
12182024-11-01T08:31:25.137ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
12192024-11-01T08:31:25.137ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a0c3e848-f136-4ae5-b986-95beae550c75
12202024-11-01T08:31:25.137ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12212024-11-01T08:31:25.137ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12222024-11-01T08:31:25.137ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12232024-11-01T08:31:25.137ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12242024-11-01T08:31:25.137ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12252024-11-01T08:31:25.137ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12262024-11-01T08:31:25.138ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12272024-11-01T08:31:25.138ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12282024-11-01T08:31:25.138ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
12292024-11-01T08:31:25.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12302024-11-01T08:31:25.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12312024-11-01T08:31:25.140ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12322024-11-01T08:31:25.140ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2be9836-5f76-4a1f-8a69-d27eef06e7bc", "content-length": "2", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
12332024-11-01T08:31:25.140ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12342024-11-01T08:31:25.140ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b410cfe-7a1f-4835-b9b7-9761e6e01c2a", "content-length": "52", "date": "Fri, 01 Nov 2024 08:31:24 GMT"} })
12352024-11-01T08:31:25.140ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
12362024-11-01T08:31:25.140ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12372024-11-01T08:31:25.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7b4697dc-91a2-4775-b9c3-9a630be27b86 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12382024-11-01T08:31:25.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7b4697dc-91a2-4775-b9c3-9a630be27b86 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12392024-11-01T08:31:25.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7b4697dc-91a2-4775-b9c3-9a630be27b86 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12402024-11-01T08:31:25.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 97c6669d-eefc-413e-80de-21f71b1b99bb roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
12412024-11-01T08:31:25.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 97c6669d-eefc-413e-80de-21f71b1b99bb resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
12422024-11-01T08:31:25.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 97c6669d-eefc-413e-80de-21f71b1b99bb response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
12432024-11-01T08:31:25.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 591e706d-eea0-40bc-920a-acd1e7a4a090 roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
12442024-11-01T08:31:25.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 591e706d-eea0-40bc-920a-acd1e7a4a090 resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
12452024-11-01T08:31:25.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 591e706d-eea0-40bc-920a-acd1e7a4a090 response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
12462024-11-01T08:31:25.264ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "67487fb4-e8f2-4c70-a050-1127681fe70a", "date": "Fri, 01 Nov 2024 08:31:25 GMT"} })
12472024-11-01T08:31:25.264ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch = Switch0
12482024-11-01T08:31:25.264ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12492024-11-01T08:31:25.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c75b3c5-950a-40b1-b047-8f30a712bfc2", "content-length": "669", "date": "Fri, 01 Nov 2024 08:31:25 GMT"} })
12502024-11-01T08:31:25.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12512024-11-01T08:31:25.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12522024-11-01T08:31:25.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12532024-11-01T08:31:25.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12542024-11-01T08:31:25.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12552024-11-01T08:31:25.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12562024-11-01T08:31:25.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12572024-11-01T08:31:25.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12582024-11-01T08:31:25.284ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 587.95747ms iteration = 24 status = {}
12592024-11-01T08:31:25.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = fecfe62a-66c5-4f50-aaec-875e1f0fd338 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12602024-11-01T08:31:25.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = fecfe62a-66c5-4f50-aaec-875e1f0fd338 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12612024-11-01T08:31:25.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = fecfe62a-66c5-4f50-aaec-875e1f0fd338 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12622024-11-01T08:31:26.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d1db4de6-7b62-4209-9dd7-f5bde7230a1c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12632024-11-01T08:31:26.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d1db4de6-7b62-4209-9dd7-f5bde7230a1c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12642024-11-01T08:31:26.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d1db4de6-7b62-4209-9dd7-f5bde7230a1c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12652024-11-01T08:31:27.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bbe6e317-81a7-4b1e-a701-e09bde3a34d7 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12662024-11-01T08:31:27.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bbe6e317-81a7-4b1e-a701-e09bde3a34d7 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12672024-11-01T08:31:27.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bbe6e317-81a7-4b1e-a701-e09bde3a34d7 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12682024-11-01T08:31:28.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4c7ad9f2-7874-404c-86f1-db9716f99f59 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12692024-11-01T08:31:28.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4c7ad9f2-7874-404c-86f1-db9716f99f59 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12702024-11-01T08:31:28.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4c7ad9f2-7874-404c-86f1-db9716f99f59 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12712024-11-01T08:31:29.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5b727aa5-cb48-4d37-8c24-6e991718027f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12722024-11-01T08:31:29.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5b727aa5-cb48-4d37-8c24-6e991718027f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12732024-11-01T08:31:29.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5b727aa5-cb48-4d37-8c24-6e991718027f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12742024-11-01T08:31:30.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 44a10696-4478-4f82-a0ea-458a93816eb2 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12752024-11-01T08:31:30.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 44a10696-4478-4f82-a0ea-458a93816eb2 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12762024-11-01T08:31:30.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 44a10696-4478-4f82-a0ea-458a93816eb2 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12772024-11-01T08:31:31.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f3cac4ba-5663-4d58-92b3-c5b703a5d28a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12782024-11-01T08:31:31.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f3cac4ba-5663-4d58-92b3-c5b703a5d28a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12792024-11-01T08:31:31.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f3cac4ba-5663-4d58-92b3-c5b703a5d28a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12802024-11-01T08:31:32.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a30b6c00-5019-4e94-9a99-796da005b1d7 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12812024-11-01T08:31:32.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a30b6c00-5019-4e94-9a99-796da005b1d7 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12822024-11-01T08:31:32.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a30b6c00-5019-4e94-9a99-796da005b1d7 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12832024-11-01T08:31:33.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1e98a391-d46c-4f0a-97f5-d507eb8ec517 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12842024-11-01T08:31:33.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1e98a391-d46c-4f0a-97f5-d507eb8ec517 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12852024-11-01T08:31:33.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1e98a391-d46c-4f0a-97f5-d507eb8ec517 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12862024-11-01T08:31:34.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6a1893c3-44e7-4792-8d5a-205f9e3a49b3 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12872024-11-01T08:31:34.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6a1893c3-44e7-4792-8d5a-205f9e3a49b3 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12882024-11-01T08:31:34.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6a1893c3-44e7-4792-8d5a-205f9e3a49b3 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
12892024-11-01T08:31:34.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
12902024-11-01T08:31:34.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12912024-11-01T08:31:34.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12922024-11-01T08:31:34.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
12932024-11-01T08:31:34.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12942024-11-01T08:31:34.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12952024-11-01T08:31:34.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12962024-11-01T08:31:34.699ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12972024-11-01T08:31:34.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12982024-11-01T08:31:34.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.305091ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12992024-11-01T08:31:34.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13002024-11-01T08:31:34.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13012024-11-01T08:31:34.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13022024-11-01T08:31:34.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13032024-11-01T08:31:34.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13042024-11-01T08:31:34.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13052024-11-01T08:31:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
13062024-11-01T08:31:34.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13072024-11-01T08:31:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13082024-11-01T08:31:34.716ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
13092024-11-01T08:31:34.716ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.040092ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
13102024-11-01T08:31:35.201ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1336 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = b57da4da-83e7-45a2-8520-a25bfe277932 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
13112024-11-01T08:31:35.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0d4865d9-b02f-43c4-b75a-4dca644df424 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13122024-11-01T08:31:35.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0d4865d9-b02f-43c4-b75a-4dca644df424 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13132024-11-01T08:31:35.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0d4865d9-b02f-43c4-b75a-4dca644df424 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13142024-11-01T08:31:36.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5d2a594c-3531-4929-b096-724b6f084f76 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13152024-11-01T08:31:36.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5d2a594c-3531-4929-b096-724b6f084f76 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13162024-11-01T08:31:36.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5d2a594c-3531-4929-b096-724b6f084f76 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13172024-11-01T08:31:37.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ba2be061-f4db-4f25-8f92-097872a7e993 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13182024-11-01T08:31:37.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ba2be061-f4db-4f25-8f92-097872a7e993 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13192024-11-01T08:31:37.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ba2be061-f4db-4f25-8f92-097872a7e993 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13202024-11-01T08:31:38.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = eb666e61-28ea-4736-8b43-11592de304be roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13212024-11-01T08:31:38.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = eb666e61-28ea-4736-8b43-11592de304be resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13222024-11-01T08:31:38.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = eb666e61-28ea-4736-8b43-11592de304be response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13232024-11-01T08:31:39.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1afd4019-1fef-458b-b110-7f6ed91e92ed roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13242024-11-01T08:31:39.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1afd4019-1fef-458b-b110-7f6ed91e92ed resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13252024-11-01T08:31:39.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1afd4019-1fef-458b-b110-7f6ed91e92ed response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13262024-11-01T08:31:39.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = ad30b772-f17f-4706-abe9-b4ba2d288310 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13272024-11-01T08:31:39.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = ad30b772-f17f-4706-abe9-b4ba2d288310 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
13282024-11-01T08:31:39.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = ad30b772-f17f-4706-abe9-b4ba2d288310 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
13292024-11-01T08:31:39.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 1466c55b-e160-4dcf-b9f1-2fdd7714e897 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
13302024-11-01T08:31:39.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 1466c55b-e160-4dcf-b9f1-2fdd7714e897 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
13312024-11-01T08:31:39.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 1466c55b-e160-4dcf-b9f1-2fdd7714e897 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
13322024-11-01T08:31:40.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e5ca4a0a-0294-43b4-b9c7-4f8d5c809740 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13332024-11-01T08:31:40.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e5ca4a0a-0294-43b4-b9c7-4f8d5c809740 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13342024-11-01T08:31:40.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e5ca4a0a-0294-43b4-b9c7-4f8d5c809740 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13352024-11-01T08:31:41.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 39241ac5-b746-40fd-9dc4-05100f56553c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13362024-11-01T08:31:41.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 39241ac5-b746-40fd-9dc4-05100f56553c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13372024-11-01T08:31:41.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 39241ac5-b746-40fd-9dc4-05100f56553c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13382024-11-01T08:31:42.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3c4c42bf-e938-467b-a01b-a06bade53529 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13392024-11-01T08:31:42.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3c4c42bf-e938-467b-a01b-a06bade53529 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13402024-11-01T08:31:42.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3c4c42bf-e938-467b-a01b-a06bade53529 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13412024-11-01T08:31:43.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8f39c085-cc21-467c-bc31-3930577f556a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13422024-11-01T08:31:43.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8f39c085-cc21-467c-bc31-3930577f556a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13432024-11-01T08:31:43.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8f39c085-cc21-467c-bc31-3930577f556a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13442024-11-01T08:31:44.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fad0a22b-a9af-464a-8a00-08e7e0c06db5 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13452024-11-01T08:31:44.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fad0a22b-a9af-464a-8a00-08e7e0c06db5 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13462024-11-01T08:31:44.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fad0a22b-a9af-464a-8a00-08e7e0c06db5 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13472024-11-01T08:31:44.697ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
13482024-11-01T08:31:44.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13492024-11-01T08:31:44.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13502024-11-01T08:31:44.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
13512024-11-01T08:31:44.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13522024-11-01T08:31:44.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13532024-11-01T08:31:44.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13542024-11-01T08:31:44.699ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13552024-11-01T08:31:44.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13562024-11-01T08:31:44.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.853295ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13572024-11-01T08:31:44.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13582024-11-01T08:31:44.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13592024-11-01T08:31:44.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13602024-11-01T08:31:44.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13612024-11-01T08:31:44.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13622024-11-01T08:31:44.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13632024-11-01T08:31:44.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
13642024-11-01T08:31:44.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13652024-11-01T08:31:44.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13662024-11-01T08:31:44.722ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
13672024-11-01T08:31:44.722ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.866771ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
13682024-11-01T08:31:45.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1f77adbf-a8d7-4135-8612-947557ab6fa5 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13692024-11-01T08:31:45.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1f77adbf-a8d7-4135-8612-947557ab6fa5 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13702024-11-01T08:31:45.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1f77adbf-a8d7-4135-8612-947557ab6fa5 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13712024-11-01T08:31:46.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c16fbff4-7671-4890-850d-392dd51fdba7 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13722024-11-01T08:31:46.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c16fbff4-7671-4890-850d-392dd51fdba7 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13732024-11-01T08:31:46.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c16fbff4-7671-4890-850d-392dd51fdba7 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13742024-11-01T08:31:46.769ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e1f4ad5a-22c4-49f7-8469-943bff23ce6e uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-01T08:31:46.764459154Z }
13752024-11-01T08:31:46.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e1f4ad5a-22c4-49f7-8469-943bff23ce6e roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
13762024-11-01T08:31:46.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e1f4ad5a-22c4-49f7-8469-943bff23ce6e resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
13772024-11-01T08:31:46.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31025 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e1f4ad5a-22c4-49f7-8469-943bff23ce6e response_code = 204 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
13782024-11-01T08:31:46.796ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 749fde64-b5b0-41f1-b898-d991f773fd4d uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T08:31:46.796672056Z }
13792024-11-01T08:31:46.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 749fde64-b5b0-41f1-b898-d991f773fd4d roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
13802024-11-01T08:31:46.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 749fde64-b5b0-41f1-b898-d991f773fd4d resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
13812024-11-01T08:31:46.798ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:52309
13822024-11-01T08:31:46.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:52309 req_id = 7f7e9cd6-7efe-4c64-a4ea-8a18babb458e roles = RoleSet { roles: {} } uri = /metrics/producers
13832024-11-01T08:31:46.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:52309 req_id = 7f7e9cd6-7efe-4c64-a4ea-8a18babb458e resource = Database result = Ok(()) uri = /metrics/producers
13842024-11-01T08:31:46.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36080 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 749fde64-b5b0-41f1-b898-d991f773fd4d response_code = 204 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
13852024-11-01T08:31:46.837ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = 11684db6-af09-4413-bb93-4c4d7433d660
13862024-11-01T08:31:46.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38898 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:52309 req_id = 7f7e9cd6-7efe-4c64-a4ea-8a18babb458e response_code = 201 uri = /metrics/producers
13872024-11-01T08:31:47.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ccc63524-c73e-4c6a-9691-28f0547f3c84 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13882024-11-01T08:31:47.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ccc63524-c73e-4c6a-9691-28f0547f3c84 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13892024-11-01T08:31:47.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ccc63524-c73e-4c6a-9691-28f0547f3c84 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13902024-11-01T08:31:48.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 701b5a6a-d6bf-4915-a469-979b86257417 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13912024-11-01T08:31:48.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 701b5a6a-d6bf-4915-a469-979b86257417 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13922024-11-01T08:31:48.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 701b5a6a-d6bf-4915-a469-979b86257417 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13932024-11-01T08:31:49.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 451f5820-785b-407a-926d-fd2529772862 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13942024-11-01T08:31:49.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 451f5820-785b-407a-926d-fd2529772862 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13952024-11-01T08:31:49.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 451f5820-785b-407a-926d-fd2529772862 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13962024-11-01T08:31:50.205ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = a25df527-1123-4ed6-b2b4-2d2f5a6f8ff0 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
13972024-11-01T08:31:50.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5c90e695-f7bb-4745-adf7-b2bcaab46294 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13982024-11-01T08:31:50.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5c90e695-f7bb-4745-adf7-b2bcaab46294 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
13992024-11-01T08:31:50.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5c90e695-f7bb-4745-adf7-b2bcaab46294 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
14002024-11-01T08:31:51.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 58fc1c92-0c97-43ff-8aa4-8d7fe8e892a9 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
14012024-11-01T08:31:51.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 58fc1c92-0c97-43ff-8aa4-8d7fe8e892a9 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
14022024-11-01T08:31:51.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 58fc1c92-0c97-43ff-8aa4-8d7fe8e892a9 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
14032024-11-01T08:31:52.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bb096103-d803-4f42-9060-e863950d850c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
14042024-11-01T08:31:52.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bb096103-d803-4f42-9060-e863950d850c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
14052024-11-01T08:31:52.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bb096103-d803-4f42-9060-e863950d850c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
14062024-11-01T08:31:53.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1fc75743-c1da-4224-a03b-e44db35c7c76 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
14072024-11-01T08:31:53.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1fc75743-c1da-4224-a03b-e44db35c7c76 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
14082024-11-01T08:31:53.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1fc75743-c1da-4224-a03b-e44db35c7c76 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
14092024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
14102024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
14112024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14122024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
14132024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14142024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
14152024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14162024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
14172024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14182024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
14192024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14202024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
14212024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
14222024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
14232024-11-01T08:31:54.696ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876
14242024-11-01T08:31:54.696ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14252024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
14262024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.061\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876"}
14272024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14282024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14292024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
14302024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
14312024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
14322024-11-01T08:31:54.696ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
14332024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14342024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14352024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
14362024-11-01T08:31:54.697ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 08:21:54.696968858 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14372024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
14382024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14392024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
14402024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
14412024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14422024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14432024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
14442024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14452024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14462024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
14472024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14482024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14492024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14502024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14512024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14522024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14532024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14542024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14552024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14562024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
14572024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
14582024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14592024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
14602024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14612024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14622024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
14632024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14642024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14652024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
14662024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14672024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
14682024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
14692024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 33.97\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
14702024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.65\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
14712024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
14722024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14732024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
14742024-11-01T08:31:54.697ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14752024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.05\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
14762024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
14772024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14782024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
14792024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14802024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.05\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
14812024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14822024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14832024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14842024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14852024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14862024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14872024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14882024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14892024-11-01T08:31:54.697ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7a6aafb-271b-4c58-a4ee-a120d4fe517b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5a9d05d-8509-4c10-96d8-97ac84fede0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5a9d05d-8509-4c10-96d8-97ac84fede0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 4879, tv_nsec: 541647177 } })
14902024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14912024-11-01T08:31:54.697ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4bab0cba-a00a-4740-88aa-0040e016028d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("726c5ac9-9d5f-4339-8159-0a04793fd959.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 4879, tv_nsec: 541668757 } })
14922024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14932024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14942024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14952024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14962024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14972024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14982024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14992024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15002024-11-01T08:31:54.697ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15012024-11-01T08:31:54.698ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
15022024-11-01T08:31:54.698ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.240821ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
15032024-11-01T08:31:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15042024-11-01T08:31:54.698ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15052024-11-01T08:31:54.698ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
15062024-11-01T08:31:54.698ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.23008ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
15072024-11-01T08:31:54.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15082024-11-01T08:31:54.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15092024-11-01T08:31:54.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15102024-11-01T08:31:54.700ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15112024-11-01T08:31:54.701ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15122024-11-01T08:31:54.701ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.022763ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15132024-11-01T08:31:54.702ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4879, tv_nsec: 546827714 } })
15142024-11-01T08:31:54.703ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
15152024-11-01T08:31:54.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15162024-11-01T08:31:54.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15172024-11-01T08:31:54.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15182024-11-01T08:31:54.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15192024-11-01T08:31:54.704ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15202024-11-01T08:31:54.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15212024-11-01T08:31:54.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15222024-11-01T08:31:54.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15232024-11-01T08:31:54.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15242024-11-01T08:31:54.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15252024-11-01T08:31:54.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15262024-11-01T08:31:54.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15272024-11-01T08:31:54.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15282024-11-01T08:31:54.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15292024-11-01T08:31:54.706ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15302024-11-01T08:31:54.708ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 08:21:54.696968858 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15312024-11-01T08:31:54.708ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.291928ms iteration = 13 status = {"expiration":"2024-11-01T08:21:54.696968858Z","pruned":[]}
15322024-11-01T08:31:54.708ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15332024-11-01T08:31:54.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15342024-11-01T08:31:54.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15352024-11-01T08:31:54.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15362024-11-01T08:31:54.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15372024-11-01T08:31:54.711ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15382024-11-01T08:31:54.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15392024-11-01T08:31:54.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15402024-11-01T08:31:54.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15412024-11-01T08:31:54.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15422024-11-01T08:31:54.713ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4879, tv_nsec: 557404164 } })
15432024-11-01T08:31:54.713ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15442024-11-01T08:31:54.713ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
15452024-11-01T08:31:54.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15462024-11-01T08:31:54.713ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15472024-11-01T08:31:54.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15482024-11-01T08:31:54.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15492024-11-01T08:31:54.716ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15502024-11-01T08:31:54.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15512024-11-01T08:31:54.717ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15522024-11-01T08:31:54.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15532024-11-01T08:31:54.720ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.670977ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
15542024-11-01T08:31:54.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15552024-11-01T08:31:54.721ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15562024-11-01T08:31:54.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15572024-11-01T08:31:54.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15582024-11-01T08:31:54.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15592024-11-01T08:31:54.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15602024-11-01T08:31:54.728ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15612024-11-01T08:31:54.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15622024-11-01T08:31:54.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15632024-11-01T08:31:54.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15642024-11-01T08:31:54.730ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4879, tv_nsec: 574564175 } })
15652024-11-01T08:31:54.730ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
15662024-11-01T08:31:54.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15672024-11-01T08:31:54.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15682024-11-01T08:31:54.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15692024-11-01T08:31:54.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15702024-11-01T08:31:54.738ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15712024-11-01T08:31:54.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15722024-11-01T08:31:54.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15732024-11-01T08:31:54.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15742024-11-01T08:31:54.775ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15752024-11-01T08:31:54.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15762024-11-01T08:31:54.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 82.099988ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15772024-11-01T08:31:54.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.665126ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15782024-11-01T08:31:54.782ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792024-11-01T08:31:54.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15802024-11-01T08:31:54.785ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15812024-11-01T08:31:54.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15822024-11-01T08:31:54.786ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15832024-11-01T08:31:54.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15842024-11-01T08:31:54.786ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15852024-11-01T08:31:54.786ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15862024-11-01T08:31:54.786ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 89.12985ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15872024-11-01T08:31:54.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15882024-11-01T08:31:54.789ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15892024-11-01T08:31:54.789ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15902024-11-01T08:31:54.789ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15912024-11-01T08:31:54.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15922024-11-01T08:31:54.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15932024-11-01T08:31:54.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15942024-11-01T08:31:54.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15952024-11-01T08:31:54.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15962024-11-01T08:31:54.792ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15972024-11-01T08:31:54.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15982024-11-01T08:31:54.793ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15992024-11-01T08:31:54.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16002024-11-01T08:31:54.794ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16012024-11-01T08:31:54.794ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16022024-11-01T08:31:54.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16032024-11-01T08:31:54.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16042024-11-01T08:31:54.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16052024-11-01T08:31:54.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16062024-11-01T08:31:54.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16072024-11-01T08:31:54.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16082024-11-01T08:31:54.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16092024-11-01T08:31:54.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16102024-11-01T08:31:54.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16112024-11-01T08:31:54.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16122024-11-01T08:31:54.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16132024-11-01T08:31:54.803ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 106.267631ms iteration = 6 status = {"nsuccess":5}
16142024-11-01T08:31:54.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16152024-11-01T08:31:54.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16162024-11-01T08:31:54.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16172024-11-01T08:31:54.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16182024-11-01T08:31:54.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16192024-11-01T08:31:54.811ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
16202024-11-01T08:31:54.811ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
16212024-11-01T08:31:54.811ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 114.801501ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
16222024-11-01T08:31:54.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16232024-11-01T08:31:54.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16242024-11-01T08:31:54.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
16252024-11-01T08:31:54.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16262024-11-01T08:31:54.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16272024-11-01T08:31:54.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16282024-11-01T08:31:54.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16292024-11-01T08:31:54.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16302024-11-01T08:31:54.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f7fe3bf0-db6a-428d-8129-f334aa61483d, lookup_type: ById(f7fe3bf0-db6a-428d-8129-f334aa61483d) } result = Ok(())
16312024-11-01T08:31:54.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16322024-11-01T08:31:54.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16332024-11-01T08:31:54.828ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 131.41971ms iteration = 25 status = 0
16342024-11-01T08:31:54.834ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
16352024-11-01T08:31:54.834ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 138.170555ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
16362024-11-01T08:31:54.843ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16372024-11-01T08:31:54.843ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16382024-11-01T08:31:54.843ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16392024-11-01T08:31:54.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16402024-11-01T08:31:54.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16412024-11-01T08:31:54.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16422024-11-01T08:31:54.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16432024-11-01T08:31:54.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16442024-11-01T08:31:54.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16452024-11-01T08:31:54.850ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16462024-11-01T08:31:54.850ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b06c736-f13d-44f4-95f3-1c25c945a356 dns_zone_name = oxide.test found_so_far = 0 version = 2
16472024-11-01T08:31:54.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16482024-11-01T08:31:54.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16492024-11-01T08:31:54.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16502024-11-01T08:31:54.854ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16512024-11-01T08:31:54.854ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16522024-11-01T08:31:54.854ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.775283ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16532024-11-01T08:31:54.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16542024-11-01T08:31:54.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16552024-11-01T08:31:54.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16562024-11-01T08:31:54.859ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16572024-11-01T08:31:54.859ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16582024-11-01T08:31:54.859ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16592024-11-01T08:31:54.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16602024-11-01T08:31:54.859ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b06c736-f13d-44f4-95f3-1c25c945a356 dns_zone_name = oxide.test found_so_far = 1 version = 2
16612024-11-01T08:31:54.859ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16622024-11-01T08:31:54.859ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 08:20:37.945638 UTC dns_group = external generation = 2
16632024-11-01T08:31:54.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 162.836092ms iteration = 14 status = {"generation":2}
16642024-11-01T08:31:54.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16652024-11-01T08:31:54.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16662024-11-01T08:31:54.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16672024-11-01T08:31:54.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16682024-11-01T08:31:54.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16692024-11-01T08:31:54.863ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16702024-11-01T08:31:54.864ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16712024-11-01T08:31:54.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16722024-11-01T08:31:54.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16732024-11-01T08:31:54.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16742024-11-01T08:31:54.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16752024-11-01T08:31:54.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16762024-11-01T08:31:54.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16772024-11-01T08:31:54.876ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
16782024-11-01T08:31:54.876ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16792024-11-01T08:31:54.877ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1bd8519-5557-41fe-9f6d-6cc10f721bf5", "content-length": "26", "date": "Fri, 01 Nov 2024 08:31:54 GMT"} })
16802024-11-01T08:31:54.877ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16812024-11-01T08:31:54.880ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16822024-11-01T08:31:54.880ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 182.936906ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16832024-11-01T08:31:54.882ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16842024-11-01T08:31:54.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ef7eadfa-4839-4129-85f7-b912287cd348 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
16852024-11-01T08:31:54.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ef7eadfa-4839-4129-85f7-b912287cd348 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
16862024-11-01T08:31:54.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16872024-11-01T08:31:54.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16882024-11-01T08:31:54.938ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 241.569197ms iteration = 29 status = {"physical_disks_added":0}
16892024-11-01T08:31:54.991ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
16902024-11-01T08:31:54.991ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16912024-11-01T08:31:54.991ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "08ec11b4-9603-4a45-b2c3-8ee192c12034", "content-length": "26", "date": "Fri, 01 Nov 2024 08:31:54 GMT"} })
16922024-11-01T08:31:54.991ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16932024-11-01T08:31:54.994ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16942024-11-01T08:31:55.061ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 zone_address = fd00:1122:3344:101::2
16952024-11-01T08:31:55.061ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16962024-11-01T08:31:55.061ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "df7c8ee9-f140-4fda-b6c3-2c40a57d71da", "content-length": "26", "date": "Fri, 01 Nov 2024 08:31:54 GMT"} })
16972024-11-01T08:31:55.061ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16982024-11-01T08:31:55.064ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
16992024-11-01T08:31:55.089ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
17002024-11-01T08:31:55.092ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
17012024-11-01T08:31:55.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "86d724df-1020-4740-8f36-7ae932ef0d92", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17022024-11-01T08:31:55.092ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17032024-11-01T08:31:55.094ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f04096b4-8a26-4a5b-a014-08a395769afb", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17042024-11-01T08:31:55.094ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17052024-11-01T08:31:55.097ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17062024-11-01T08:31:55.097ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 401.162419ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17072024-11-01T08:31:55.133ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17082024-11-01T08:31:55.133ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17092024-11-01T08:31:55.133ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c01134df-881a-4fb8-a145-0730b5f45f57", "content-length": "585", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} })
17102024-11-01T08:31:55.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17112024-11-01T08:31:55.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17122024-11-01T08:31:55.167ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5/state
17132024-11-01T08:31:55.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 279241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ef7eadfa-4839-4129-85f7-b912287cd348 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
17142024-11-01T08:31:55.171ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T08:19:51.214273Z, time_modified: 2024-11-01T08:19:51.214273Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f8c93fa7-6555-4906-9ff7-39adb002e287, db_silo: Silo { identity: SiloIdentity { id: f8c93fa7-6555-4906-9ff7-39adb002e287, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T08:20:37.795553Z, time_modified: 2024-11-01T08:20:37.795553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f8c93fa7-6555-4906-9ff7-39adb002e287, db_silo: Silo { identity: SiloIdentity { id: f8c93fa7-6555-4906-9ff7-39adb002e287, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T08:20:37.795553Z, time_modified: 2024-11-01T08:20:37.795553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
17152024-11-01T08:31:55.171ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 474.493131ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f8c93fa7-6555-4906-9ff7-39adb002e287","tls_certs":["03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372"]}},"default_endpoint":{"silo_id":"f8c93fa7-6555-4906-9ff7-39adb002e287","tls_certs":["03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17162024-11-01T08:31:55.179ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "f88aa2af-7177-4341-9443-9890cf391fcc", "content-length": "130", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} })
17172024-11-01T08:31:55.179ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T08:31:46.796672056Z }, migration_in: None, migration_out: None } vmm_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
17182024-11-01T08:31:55.179ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d vmm_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T08:31:46.796672056Z }
17192024-11-01T08:31:55.179ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 roles = RoleSet { roles: {} } sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d vmm_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
17202024-11-01T08:31:55.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 resource = Database result = Ok(()) sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d vmm_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
17212024-11-01T08:31:55.179ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 483.01464ms iteration = 25 status = {}
17222024-11-01T08:31:55.195ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17232024-11-01T08:31:55.196ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a41615f5-1abc-46b4-8776-29f19cade6ca", "content-length": "1", "date": "Fri, 01 Nov 2024 08:31:54 GMT"} })
17242024-11-01T08:31:55.198ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17252024-11-01T08:31:55.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17262024-11-01T08:31:55.199ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17272024-11-01T08:31:55.199ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1a6211e1-bd03-4044-93cd-6a5868005875 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17282024-11-01T08:31:55.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17292024-11-01T08:31:55.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17302024-11-01T08:31:55.201ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 504.17088ms iteration = 25 status = null
17312024-11-01T08:31:55.202ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17322024-11-01T08:31:55.203ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "edd3630a-89fc-4fc1-8a74-c2553567368a", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17332024-11-01T08:31:55.203ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17342024-11-01T08:31:55.205ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b30b0bc7-6a5b-4d32-987b-0e79f2c891d9", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17352024-11-01T08:31:55.205ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17362024-11-01T08:31:55.208ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "605271f1-9f72-47bf-9874-4c42f4350b6c", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17372024-11-01T08:31:55.208ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17382024-11-01T08:31:55.210ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
17392024-11-01T08:31:55.210ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 513.195272ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17402024-11-01T08:31:55.213ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {e7eb2722-6b59-4e1a-8c72-5482f793ac6f: {10.151.2.176: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}, 10.151.2.175: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17412024-11-01T08:31:55.213ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17422024-11-01T08:31:55.213ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "98105b27-f75c-48c8-8855-d11e258fdff9", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} })
17432024-11-01T08:31:55.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17442024-11-01T08:31:55.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17452024-11-01T08:31:55.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17462024-11-01T08:31:55.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17472024-11-01T08:31:55.215ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
17482024-11-01T08:31:55.217ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 519.779263ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
17492024-11-01T08:31:55.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17502024-11-01T08:31:55.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17512024-11-01T08:31:55.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17522024-11-01T08:31:55.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17532024-11-01T08:31:55.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17542024-11-01T08:31:55.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17552024-11-01T08:31:55.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17562024-11-01T08:31:55.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17572024-11-01T08:31:55.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17582024-11-01T08:31:55.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17592024-11-01T08:31:55.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17602024-11-01T08:31:55.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17612024-11-01T08:31:55.230ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17622024-11-01T08:31:55.230ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17632024-11-01T08:31:55.230ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17642024-11-01T08:31:55.231ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "19efbe22-f6c5-4397-a469-72a6fe6e4377", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} })
17652024-11-01T08:31:55.232ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1a6211e1-bd03-4044-93cd-6a5868005875 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17662024-11-01T08:31:55.232ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17672024-11-01T08:31:55.232ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 08:20:37.196977 UTC dns_group = internal generation = 1
17682024-11-01T08:31:55.232ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 535.291485ms iteration = 14 status = {"generation":1}
17692024-11-01T08:31:55.233ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 535.717556ms iteration = 26 status = {}
17702024-11-01T08:31:55.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17712024-11-01T08:31:55.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17722024-11-01T08:31:55.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17732024-11-01T08:31:55.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17742024-11-01T08:31:55.265ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17752024-11-01T08:31:55.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17762024-11-01T08:31:55.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17772024-11-01T08:31:55.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17782024-11-01T08:31:55.267ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e2aedfd9-3b4d-40ab-920a-0ddf803678fe, rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a0c3e848-f136-4ae5-b986-95beae550c75) } rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
17792024-11-01T08:31:55.267ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17802024-11-01T08:31:55.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17812024-11-01T08:31:55.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17822024-11-01T08:31:55.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17832024-11-01T08:31:55.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17842024-11-01T08:31:55.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17852024-11-01T08:31:55.278ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17862024-11-01T08:31:55.278ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "12a6b634-97dd-473d-8f2e-b450d1da9ace", "content-length": "121", "date": "Fri, 01 Nov 2024 08:31:54 GMT"} })
17872024-11-01T08:31:55.278ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
17882024-11-01T08:31:55.278ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a0c3e848-f136-4ae5-b986-95beae550c75
17892024-11-01T08:31:55.279ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17902024-11-01T08:31:55.279ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17912024-11-01T08:31:55.279ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17922024-11-01T08:31:55.279ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17932024-11-01T08:31:55.279ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17942024-11-01T08:31:55.279ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17952024-11-01T08:31:55.279ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17962024-11-01T08:31:55.279ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17972024-11-01T08:31:55.279ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
17982024-11-01T08:31:55.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17992024-11-01T08:31:55.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18002024-11-01T08:31:55.281ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18012024-11-01T08:31:55.281ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c1ecf28-2f1f-4b06-9b49-37cd82cd7f44", "content-length": "2", "date": "Fri, 01 Nov 2024 08:31:54 GMT"} })
18022024-11-01T08:31:55.281ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18032024-11-01T08:31:55.281ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e6f7ea3-b77f-4b49-a131-35d13307c83b", "content-length": "52", "date": "Fri, 01 Nov 2024 08:31:54 GMT"} })
18042024-11-01T08:31:55.281ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
18052024-11-01T08:31:55.281ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18062024-11-01T08:31:55.356ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18072024-11-01T08:31:55.399ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "886cd676-254b-4497-b030-0ed8bdc041f8", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} })
18082024-11-01T08:31:55.399ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch = Switch0
18092024-11-01T08:31:55.399ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18102024-11-01T08:31:55.399ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b22e440f-50e9-4a77-874b-c2e0e5f35c3d", "content-length": "811", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} })
18112024-11-01T08:31:55.399ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(12028161) }} sled = sock
18122024-11-01T08:31:55.399ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18132024-11-01T08:31:55.399ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18142024-11-01T08:31:55.399ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffa1f8cc-4323-46fb-9e2b-e429aad0a1a7", "content-length": "669", "date": "Fri, 01 Nov 2024 08:31:55 GMT"} })
18152024-11-01T08:31:55.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18162024-11-01T08:31:55.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18172024-11-01T08:31:55.401ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 704.429992ms iteration = 25 status = {}
18182024-11-01T08:31:55.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18192024-11-01T08:31:55.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18202024-11-01T08:31:55.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18212024-11-01T08:31:55.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18222024-11-01T08:31:55.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18232024-11-01T08:31:55.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18242024-11-01T08:31:55.420ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 723.295216ms iteration = 25 status = {}
18252024-11-01T08:31:56.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 34e39886-d524-4b45-9c40-265b8e965bb9 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18262024-11-01T08:31:56.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 34e39886-d524-4b45-9c40-265b8e965bb9 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18272024-11-01T08:31:56.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 34e39886-d524-4b45-9c40-265b8e965bb9 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18282024-11-01T08:31:57.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b8e644e9-9318-4704-a001-8a78638d5b5d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18292024-11-01T08:31:57.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b8e644e9-9318-4704-a001-8a78638d5b5d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18302024-11-01T08:31:57.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b8e644e9-9318-4704-a001-8a78638d5b5d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18312024-11-01T08:31:57.327ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d0022c99-4be0-4083-86ee-98782abc7d72 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-01T08:31:57.326837240Z }
18322024-11-01T08:31:57.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d0022c99-4be0-4083-86ee-98782abc7d72 roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18332024-11-01T08:31:57.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d0022c99-4be0-4083-86ee-98782abc7d72 resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18342024-11-01T08:31:57.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 12781 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d0022c99-4be0-4083-86ee-98782abc7d72 response_code = 204 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18352024-11-01T08:31:57.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = c64811d0-ba37-4952-aa5c-93a4ddb5fdc8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
18362024-11-01T08:31:57.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = c64811d0-ba37-4952-aa5c-93a4ddb5fdc8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
18372024-11-01T08:31:57.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = c64811d0-ba37-4952-aa5c-93a4ddb5fdc8 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
18382024-11-01T08:31:57.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = d041de93-0b62-4e0c-b6bc-e926d3b3a151 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
18392024-11-01T08:31:57.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = d041de93-0b62-4e0c-b6bc-e926d3b3a151 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
18402024-11-01T08:31:57.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = d041de93-0b62-4e0c-b6bc-e926d3b3a151 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
18412024-11-01T08:31:58.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2bbe8731-7d51-4b2d-bfa3-5c6063da21e4 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18422024-11-01T08:31:58.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2bbe8731-7d51-4b2d-bfa3-5c6063da21e4 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18432024-11-01T08:31:58.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2bbe8731-7d51-4b2d-bfa3-5c6063da21e4 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18442024-11-01T08:31:59.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4423fc5a-a80d-4d06-a6b8-4d5668013343 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18452024-11-01T08:31:59.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4423fc5a-a80d-4d06-a6b8-4d5668013343 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18462024-11-01T08:31:59.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 4423fc5a-a80d-4d06-a6b8-4d5668013343 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
18472024-11-01T08:31:59.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = b3ad8b36-8f79-4cc1-9336-e683bb7a2551 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
18482024-11-01T08:31:59.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = b3ad8b36-8f79-4cc1-9336-e683bb7a2551 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
18492024-11-01T08:31:59.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = b3ad8b36-8f79-4cc1-9336-e683bb7a2551 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
18502024-11-01T08:31:59.752ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T08:31:59.752183892Z }
18512024-11-01T08:31:59.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18522024-11-01T08:31:59.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18532024-11-01T08:31:59.760ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5 vmm_needs_update = true
18542024-11-01T08:31:59.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18552024-11-01T08:31:59.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18562024-11-01T08:31:59.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18572024-11-01T08:31:59.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18582024-11-01T08:31:59.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18592024-11-01T08:31:59.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18602024-11-01T08:31:59.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18612024-11-01T08:31:59.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18622024-11-01T08:31:59.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18632024-11-01T08:31:59.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18642024-11-01T08:31:59.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18652024-11-01T08:31:59.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18662024-11-01T08:31:59.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18672024-11-01T08:31:59.783ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f8c93fa7-6555-4906-9ff7-39adb002e287, lookup_type: ById(f8c93fa7-6555-4906-9ff7-39adb002e287) }, key: 7e2cae8b-b8fe-447c-87dc-1808aa00f5f8, lookup_type: ById(7e2cae8b-b8fe-447c-87dc-1808aa00f5f8) }, key: 11684db6-af09-4413-bb93-4c4d7433d660, lookup_type: ById(11684db6-af09-4413-bb93-4c4d7433d660) } result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18682024-11-01T08:31:59.783ZINFOnexus (dropshot_internal): starting update saga for 11684db6-af09-4413-bb93-4c4d7433d660 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T08:31:59.752183892Z }
18692024-11-01T08:31:59.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30814 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 response_code = 204 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18702024-11-01T08:31:59.783ZDEBGnexus (dropshot_internal): preparing instance-update saga for 11684db6-af09-4413-bb93-4c4d7433d660... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f043f37b-e647-4a98-bfe3-55f288c36179 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18712024-11-01T08:31:59.783ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update
18722024-11-01T08:31:59.783ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"11684db6-af09-4413-bb93-4c4d7433d660","lookup_type":{"ById":"11684db6-af09-4413-bb93-4c4d7433d660"},"parent":{"key":"7e2cae8b-b8fe-447c-87dc-1808aa00f5f8","lookup_type":{"ById":"7e2cae8b-b8fe-447c-87dc-1808aa00f5f8"},"parent":{"key":"f8c93fa7-6555-4906-9ff7-39adb002e287","lookup_type":{"ById":"f8c93fa7-6555-4906-9ff7-39adb002e287"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
18732024-11-01T08:31:59.783ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update
18742024-11-01T08:31:59.783ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7f1bd2f1-b4bd-411e-96c0-e518d9b032ac uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T08:31:59.752183892Z }
18752024-11-01T08:31:59.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7f1bd2f1-b4bd-411e-96c0-e518d9b032ac roles = RoleSet { roles: {} } uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18762024-11-01T08:31:59.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7f1bd2f1-b4bd-411e-96c0-e518d9b032ac resource = Database result = Ok(()) uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18772024-11-01T08:31:59.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5193 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7f1bd2f1-b4bd-411e-96c0-e518d9b032ac response_code = 204 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
18782024-11-01T08:31:59.813ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update
18792024-11-01T08:31:59.813ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
18802024-11-01T08:31:59.813ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
18812024-11-01T08:31:59.813ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
18822024-11-01T08:31:59.816ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
18832024-11-01T08:31:59.816ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
18842024-11-01T08:31:59.820ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
18852024-11-01T08:31:59.820ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
18862024-11-01T08:31:59.833ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
18872024-11-01T08:31:59.833ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("54f4c19a-4999-4c25-9013-fea3436b668d")) node_id = 0 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
18882024-11-01T08:31:59.837ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
18892024-11-01T08:31:59.837ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
18902024-11-01T08:31:59.843ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update
18912024-11-01T08:31:59.843ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
18922024-11-01T08:31:59.844ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
18932024-11-01T08:31:59.845ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
18942024-11-01T08:31:59.846ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
18952024-11-01T08:31:59.847ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
18962024-11-01T08:31:59.847ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
18972024-11-01T08:31:59.849ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
18982024-11-01T08:31:59.849ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
18992024-11-01T08:31:59.850ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
19002024-11-01T08:31:59.850ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
19012024-11-01T08:31:59.852ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
19022024-11-01T08:31:59.852ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
19032024-11-01T08:31:59.853ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
19042024-11-01T08:31:59.856ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f8c93fa7-6555-4906-9ff7-39adb002e287, lookup_type: ById(f8c93fa7-6555-4906-9ff7-39adb002e287) }, key: 7e2cae8b-b8fe-447c-87dc-1808aa00f5f8, lookup_type: ById(7e2cae8b-b8fe-447c-87dc-1808aa00f5f8) }, key: 11684db6-af09-4413-bb93-4c4d7433d660, lookup_type: ById(11684db6-af09-4413-bb93-4c4d7433d660) } result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
19052024-11-01T08:31:59.859ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance updater_id = 54f4c19a-4999-4c25-9013-fea3436b668d
19062024-11-01T08:31:59.859ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
19072024-11-01T08:31:59.860ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
19082024-11-01T08:31:59.872ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance updater_id = 54f4c19a-4999-4c25-9013-fea3436b668d
19092024-11-01T08:31:59.872ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
19102024-11-01T08:31:59.872ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance
19112024-11-01T08:31:59.876ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 locked_gen = Generation(Generation(2)) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = LockInstance updater_id = 54f4c19a-4999-4c25-9013-fea3436b668d
19122024-11-01T08:31:59.876ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19132024-11-01T08:31:59.876ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("54f4c19a-4999-4c25-9013-fea3436b668d")}) node_id = 1 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
19142024-11-01T08:31:59.879ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19152024-11-01T08:31:59.879ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
19162024-11-01T08:31:59.883ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19172024-11-01T08:31:59.883ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19182024-11-01T08:31:59.885ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19192024-11-01T08:31:59.885ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19202024-11-01T08:31:59.886ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19212024-11-01T08:31:59.886ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19222024-11-01T08:31:59.887ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19232024-11-01T08:31:59.890ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f8c93fa7-6555-4906-9ff7-39adb002e287, lookup_type: ById(f8c93fa7-6555-4906-9ff7-39adb002e287) }, key: 7e2cae8b-b8fe-447c-87dc-1808aa00f5f8, lookup_type: ById(7e2cae8b-b8fe-447c-87dc-1808aa00f5f8) }, key: 11684db6-af09-4413-bb93-4c4d7433d660, lookup_type: ById(11684db6-af09-4413-bb93-4c4d7433d660) } result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19242024-11-01T08:31:59.890ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19252024-11-01T08:31:59.890ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19262024-11-01T08:31:59.896ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 6fe550a6-35c1-4ea3-b3b5-4934906222d5, time_created: 2024-11-01T08:31:39.195183Z, time_deleted: None, instance_id: 11684db6-af09-4413-bb93-4c4d7433d660, sled_id: f7fe3bf0-db6a-428d-8129-f334aa61483d, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-01T08:31:59.752183Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-01T08:31:37.039123Z, gen: Generation(Generation(3)), propolis_id: Some(6fe550a6-35c1-4ea3-b3b5-4934906222d5), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(6fe550a6-35c1-4ea3-b3b5-4934906222d5 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-01T08:31:59.896815747Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
19272024-11-01T08:31:59.901ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
19282024-11-01T08:31:59.901ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"11684db6-af09-4413-bb93-4c4d7433d660","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"6fe550a6-35c1-4ea3-b3b5-4934906222d5"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"11684db6-af09-4413-bb93-4c4d7433d660","lookup_type":{"ById":"11684db6-af09-4413-bb93-4c4d7433d660"},"parent":{"key":"7e2cae8b-b8fe-447c-87dc-1808aa00f5f8","lookup_type":{"ById":"7e2cae8b-b8fe-447c-87dc-1808aa00f5f8"},"parent":{"key":"f8c93fa7-6555-4906-9ff7-39adb002e287","lookup_type":{"ById":"f8c93fa7-6555-4906-9ff7-39adb002e287"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"54f4c19a-4999-4c25-9013-fea3436b668d"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"7e2cae8b-b8fe-447c-87dc-1808aa00f5f8","ram_diff":1073741824},"destroy_active_vmm":"6fe550a6-35c1-4ea3-b3b5-4934906222d5","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-01T08:31:59.896815747Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19292024-11-01T08:31:59.901ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
19302024-11-01T08:31:59.933ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
19312024-11-01T08:31:59.933ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19322024-11-01T08:31:59.933ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19332024-11-01T08:31:59.933ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19342024-11-01T08:31:59.939ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19352024-11-01T08:31:59.939ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19362024-11-01T08:31:59.952ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19372024-11-01T08:31:59.952ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19382024-11-01T08:31:59.958ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19392024-11-01T08:31:59.959ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a48eb031-7da0-43b5-8e5b-f1ceb2131a9f")) node_id = 0 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19402024-11-01T08:31:59.966ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19412024-11-01T08:31:59.966ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19422024-11-01T08:31:59.979ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 parent_lock = UpdaterLock { updater_id: 54f4c19a-4999-4c25-9013-fea3436b668d, locked_gen: Generation(Generation(2)) } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
19432024-11-01T08:31:59.979ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = BecomeUpdater
19442024-11-01T08:31:59.979ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = BecomeUpdater
19452024-11-01T08:31:59.996ZDEBGnexus (SagaExecutor): inherited lock from 54f4c19a-4999-4c25-9013-fea3436b668d to a48eb031-7da0-43b5-8e5b-f1ceb2131a9f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 54f4c19a-4999-4c25-9013-fea3436b668d saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = BecomeUpdater updater_id = a48eb031-7da0-43b5-8e5b-f1ceb2131a9f
19462024-11-01T08:31:59.996ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
19472024-11-01T08:31:59.996ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19482024-11-01T08:31:59.996ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a48eb031-7da0-43b5-8e5b-f1ceb2131a9f")}) node_id = 1 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19492024-11-01T08:32:00.001ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19502024-11-01T08:32:00.001ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19512024-11-01T08:32:00.006ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19522024-11-01T08:32:00.006ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19532024-11-01T08:32:00.011ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19542024-11-01T08:32:00.011ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19552024-11-01T08:32:00.015ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
19562024-11-01T08:32:00.015ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660
19572024-11-01T08:32:00.018ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = UpdateNetworkConfig
19582024-11-01T08:32:00.018ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = UpdateNetworkConfig
19592024-11-01T08:32:00.020ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = UpdateNetworkConfig
19602024-11-01T08:32:00.021ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = UpdateNetworkConfig
19612024-11-01T08:32:00.023ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
19622024-11-01T08:32:00.023ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = UpdateNetworkConfig
19632024-11-01T08:32:00.023ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = UpdateNetworkConfig
19642024-11-01T08:32:00.026ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
19652024-11-01T08:32:00.026ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
19662024-11-01T08:32:00.026ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
19672024-11-01T08:32:00.027ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
19682024-11-01T08:32:00.028ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
19692024-11-01T08:32:00.028ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
19702024-11-01T08:32:00.029ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
19712024-11-01T08:32:00.033ZDEBGnexus: notifying dendrite of updates instance_id = Some(11684db6-af09-4413-bb93-4c4d7433d660 (instance)) switch = switch0
19722024-11-01T08:32:00.033ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4884, tv_nsec: 877744553 } })
19732024-11-01T08:32:00.033ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
19742024-11-01T08:32:00.064ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
19752024-11-01T08:32:00.064ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19762024-11-01T08:32:00.064ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab667222-4ca9-474a-8a18-7dfea782a05a", "content-length": "26", "date": "Fri, 01 Nov 2024 08:32:00 GMT"} })
19772024-11-01T08:32:00.064ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19782024-11-01T08:32:00.065ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19792024-11-01T08:32:00.095ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
19802024-11-01T08:32:00.096ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a5be58d-fc45-476b-a9bf-ff6f178cde53", "content-length": "4", "date": "Fri, 01 Nov 2024 08:31:59 GMT"} })
19812024-11-01T08:32:00.097ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19822024-11-01T08:32:00.097ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19832024-11-01T08:32:00.109ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19842024-11-01T08:32:00.109ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19852024-11-01T08:32:00.118ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
19862024-11-01T08:32:00.119ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
19872024-11-01T08:32:00.145ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-01T08:32:00.121932Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 7e2cae8b-b8fe-447c-87dc-1808aa00f5f8, time_modified: Some(2024-11-01T08:32:00.121932Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: f8c93fa7-6555-4906-9ff7-39adb002e287, time_modified: Some(2024-11-01T08:32:00.121932Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
19882024-11-01T08:32:00.147ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19892024-11-01T08:32:00.147ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19902024-11-01T08:32:00.154ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
19912024-11-01T08:32:00.154ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
19922024-11-01T08:32:00.166ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
19932024-11-01T08:32:00.166ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = UnassignOximeterProducer
19942024-11-01T08:32:00.166ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = UnassignOximeterProducer
19952024-11-01T08:32:00.175ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 producer_id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
19962024-11-01T08:32:00.175ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = UnassignOximeterProducer
19972024-11-01T08:32:00.175ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = UnassignOximeterProducer
19982024-11-01T08:32:00.213ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:261 id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
19992024-11-01T08:32:00.215ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/11684db6-af09-4413-bb93-4c4d7433d660
20002024-11-01T08:32:00.233ZDEBGnexus (SagaExecutor): client response oximeter-collector = 11684db6-af09-4413-bb93-4c4d7433d660 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/11684db6-af09-4413-bb93-4c4d7433d660", status: 204, headers: {"x-request-id": "a4c19b7a-1d52-43c5-af70-940671fc1cbc", "date": "Fri, 01 Nov 2024 08:32:00 GMT"} }) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
20012024-11-01T08:32:00.233ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 producer_id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
20022024-11-01T08:32:00.234ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20032024-11-01T08:32:00.234ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20042024-11-01T08:32:00.239ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20052024-11-01T08:32:00.239ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20062024-11-01T08:32:00.244ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 lock = UpdaterLock { updater_id: a48eb031-7da0-43b5-8e5b-f1ceb2131a9f, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-01T08:31:59.896815747Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
20072024-11-01T08:32:00.244ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = CommitInstanceUpdates
20082024-11-01T08:32:00.244ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = CommitInstanceUpdates
20092024-11-01T08:32:00.272ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 new_runtime = InstanceRuntimeState { time_updated: 2024-11-01T08:31:59.896815747Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
20102024-11-01T08:32:00.272ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20112024-11-01T08:32:00.272ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20122024-11-01T08:32:00.272ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
20132024-11-01T08:32:00.272ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
20142024-11-01T08:32:00.272ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20152024-11-01T08:32:00.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20162024-11-01T08:32:00.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20172024-11-01T08:32:00.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20182024-11-01T08:32:00.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20192024-11-01T08:32:00.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20202024-11-01T08:32:00.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20212024-11-01T08:32:00.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20222024-11-01T08:32:00.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20232024-11-01T08:32:00.276ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20242024-11-01T08:32:00.276ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20252024-11-01T08:32:00.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20262024-11-01T08:32:00.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20272024-11-01T08:32:00.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20282024-11-01T08:32:00.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20292024-11-01T08:32:00.281ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20302024-11-01T08:32:00.281ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("11684db6-af09-4413-bb93-4c4d7433d660"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("6fe550a6-35c1-4ea3-b3b5-4934906222d5")}) node_id = 7 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20312024-11-01T08:32:00.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20322024-11-01T08:32:00.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20332024-11-01T08:32:00.286ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20342024-11-01T08:32:00.286ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20352024-11-01T08:32:00.290ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20362024-11-01T08:32:00.290ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20372024-11-01T08:32:00.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 433059ed-9b68-4d81-9dba-87f73ad05013 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
20382024-11-01T08:32:00.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 433059ed-9b68-4d81-9dba-87f73ad05013 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
20392024-11-01T08:32:00.294ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20402024-11-01T08:32:00.294ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20412024-11-01T08:32:00.316ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20422024-11-01T08:32:00.316ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20432024-11-01T08:32:00.316ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e740086c-0976-4a67-9bac-5d1bf17af515", "content-length": "372", "date": "Fri, 01 Nov 2024 08:32:00 GMT"} })
20442024-11-01T08:32:00.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20452024-11-01T08:32:00.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20462024-11-01T08:32:00.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 25571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 433059ed-9b68-4d81-9dba-87f73ad05013 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
20472024-11-01T08:32:00.319ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
20482024-11-01T08:32:00.319ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ReleaseSledResources
20492024-11-01T08:32:00.320ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ReleaseSledResources
20502024-11-01T08:32:00.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20512024-11-01T08:32:00.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20522024-11-01T08:32:00.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20532024-11-01T08:32:00.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20542024-11-01T08:32:00.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20552024-11-01T08:32:00.325ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20562024-11-01T08:32:00.325ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20572024-11-01T08:32:00.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20582024-11-01T08:32:00.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20592024-11-01T08:32:00.328ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20602024-11-01T08:32:00.328ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20612024-11-01T08:32:00.329ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20622024-11-01T08:32:00.329ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20632024-11-01T08:32:00.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20642024-11-01T08:32:00.332ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
20652024-11-01T08:32:00.332ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = MarkVmmDeleted
20662024-11-01T08:32:00.332ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = MarkVmmDeleted
20672024-11-01T08:32:00.341ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20682024-11-01T08:32:00.341ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20692024-11-01T08:32:00.344ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20702024-11-01T08:32:00.344ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20712024-11-01T08:32:00.348ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20722024-11-01T08:32:00.348ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20732024-11-01T08:32:00.351ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
20742024-11-01T08:32:00.351ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
20752024-11-01T08:32:00.361ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {e7eb2722-6b59-4e1a-8c72-5482f793ac6f: {10.151.2.176: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}, 10.151.2.175: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20762024-11-01T08:32:00.361ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20772024-11-01T08:32:00.361ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8a580084-31a4-4564-992a-f34cea114d6e", "date": "Fri, 01 Nov 2024 08:32:00 GMT"} })
20782024-11-01T08:32:00.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20792024-11-01T08:32:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20802024-11-01T08:32:00.363ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20812024-11-01T08:32:00.364ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "37b954e6-907b-4437-bedc-f5e4a8a1cfa0", "content-length": "691", "date": "Fri, 01 Nov 2024 08:32:00 GMT"} })
20822024-11-01T08:32:00.364ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20832024-11-01T08:32:00.364ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20842024-11-01T08:32:00.364ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20852024-11-01T08:32:00.365ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 93.299393ms iteration = 26 status = {}
20862024-11-01T08:32:00.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20872024-11-01T08:32:00.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20882024-11-01T08:32:00.367ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ChainSuccessorSaga
20892024-11-01T08:32:00.368ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ChainSuccessorSaga
20902024-11-01T08:32:00.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20912024-11-01T08:32:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20922024-11-01T08:32:00.369ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ChainSuccessorSaga
20932024-11-01T08:32:00.369ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ChainSuccessorSaga
20942024-11-01T08:32:00.370ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ChainSuccessorSaga
20952024-11-01T08:32:00.371ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ChainSuccessorSaga
20962024-11-01T08:32:00.372ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ChainSuccessorSaga
20972024-11-01T08:32:00.372ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20982024-11-01T08:32:00.372ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20992024-11-01T08:32:00.373ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6a313a3e-70cf-42c2-bd63-b883e1fc1746", "date": "Fri, 01 Nov 2024 08:32:00 GMT"} })
21002024-11-01T08:32:00.375ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 103.301759ms iteration = 27 status = {}
21012024-11-01T08:32:00.375ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f8c93fa7-6555-4906-9ff7-39adb002e287, lookup_type: ById(f8c93fa7-6555-4906-9ff7-39adb002e287) }, key: 7e2cae8b-b8fe-447c-87dc-1808aa00f5f8, lookup_type: ById(7e2cae8b-b8fe-447c-87dc-1808aa00f5f8) }, key: 11684db6-af09-4413-bb93-4c4d7433d660, lookup_type: ById(11684db6-af09-4413-bb93-4c4d7433d660) } result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ChainSuccessorSaga
21022024-11-01T08:32:00.375ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ChainSuccessorSaga
21032024-11-01T08:32:00.375ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_node = ChainSuccessorSaga
21042024-11-01T08:32:00.380ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update
21052024-11-01T08:32:00.380ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21062024-11-01T08:32:00.380ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
21072024-11-01T08:32:00.384ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21082024-11-01T08:32:00.384ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
21092024-11-01T08:32:00.388ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21102024-11-01T08:32:00.388ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
21112024-11-01T08:32:00.393ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21122024-11-01T08:32:00.393ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61
21132024-11-01T08:32:00.400ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21142024-11-01T08:32:00.400ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 saga_name = instance-update saga_result = SagaResult { saga_id: 9b6065e1-9e33-461b-92ff-2f24c2b3eb61, saga_log: SagaLog { saga_id: 9b6065e1-9e33-461b-92ff-2f24c2b3eb61, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("a48eb031-7da0-43b5-8e5b-f1ceb2131a9f")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a48eb031-7da0-43b5-8e5b-f1ceb2131a9f")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("11684db6-af09-4413-bb93-4c4d7433d660"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("6fe550a6-35c1-4ea3-b3b5-4934906222d5")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("11684db6-af09-4413-bb93-4c4d7433d660"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("6fe550a6-35c1-4ea3-b3b5-4934906222d5")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("a48eb031-7da0-43b5-8e5b-f1ceb2131a9f"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("a48eb031-7da0-43b5-8e5b-f1ceb2131a9f")}} }) }
21152024-11-01T08:32:00.400ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 9b6065e1-9e33-461b-92ff-2f24c2b3eb61 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update
21162024-11-01T08:32:00.400ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21172024-11-01T08:32:00.400ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
21182024-11-01T08:32:00.406ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21192024-11-01T08:32:00.406ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
21202024-11-01T08:32:00.410ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21212024-11-01T08:32:00.410ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
21222024-11-01T08:32:00.414ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21232024-11-01T08:32:00.414ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae
21242024-11-01T08:32:00.420ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update sec_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21252024-11-01T08:32:00.420ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = c3f062fd-31ba-4c0c-a8bd-d5f23af296ae saga_name = start-instance-update saga_result = SagaResult { saga_id: c3f062fd-31ba-4c0c-a8bd-d5f23af296ae, saga_log: SagaLog { saga_id: c3f062fd-31ba-4c0c-a8bd-d5f23af296ae, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("54f4c19a-4999-4c25-9013-fea3436b668d")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("54f4c19a-4999-4c25-9013-fea3436b668d")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("54f4c19a-4999-4c25-9013-fea3436b668d"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("54f4c19a-4999-4c25-9013-fea3436b668d")}} }) }
21262024-11-01T08:32:00.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 857ebcaa-d0aa-42f8-b8dc-581fea40618e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
21272024-11-01T08:32:00.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 857ebcaa-d0aa-42f8-b8dc-581fea40618e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
21282024-11-01T08:32:00.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 857ebcaa-d0aa-42f8-b8dc-581fea40618e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
21292024-11-01T08:32:01.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = aa9d06ca-338d-4bda-901f-09f9b1730389 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21302024-11-01T08:32:01.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = aa9d06ca-338d-4bda-901f-09f9b1730389 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21312024-11-01T08:32:01.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = aa9d06ca-338d-4bda-901f-09f9b1730389 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21322024-11-01T08:32:01.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = e80bc359-2f01-4c42-84c3-5a148a322ccb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
21332024-11-01T08:32:01.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = e80bc359-2f01-4c42-84c3-5a148a322ccb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
21342024-11-01T08:32:01.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = e80bc359-2f01-4c42-84c3-5a148a322ccb response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
21352024-11-01T08:32:02.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0f993463-340c-4c7f-bf38-859d0bd4f981 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21362024-11-01T08:32:02.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0f993463-340c-4c7f-bf38-859d0bd4f981 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21372024-11-01T08:32:02.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0f993463-340c-4c7f-bf38-859d0bd4f981 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21382024-11-01T08:32:03.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1f73444b-bf1e-4d82-9b36-1dbcc3cc153a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21392024-11-01T08:32:03.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1f73444b-bf1e-4d82-9b36-1dbcc3cc153a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21402024-11-01T08:32:03.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1f73444b-bf1e-4d82-9b36-1dbcc3cc153a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21412024-11-01T08:32:04.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cc56fdba-0643-4e77-b57a-68346a325c17 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21422024-11-01T08:32:04.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cc56fdba-0643-4e77-b57a-68346a325c17 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21432024-11-01T08:32:04.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cc56fdba-0643-4e77-b57a-68346a325c17 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21442024-11-01T08:32:04.697ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
21452024-11-01T08:32:04.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21462024-11-01T08:32:04.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21472024-11-01T08:32:04.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
21482024-11-01T08:32:04.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21492024-11-01T08:32:04.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21502024-11-01T08:32:04.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21512024-11-01T08:32:04.699ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21522024-11-01T08:32:04.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21532024-11-01T08:32:04.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.199463ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21542024-11-01T08:32:04.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21552024-11-01T08:32:04.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21562024-11-01T08:32:04.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21572024-11-01T08:32:04.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21582024-11-01T08:32:04.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21592024-11-01T08:32:04.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21602024-11-01T08:32:04.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
21612024-11-01T08:32:04.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21622024-11-01T08:32:04.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21632024-11-01T08:32:04.720ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
21642024-11-01T08:32:04.720ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.120998ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
21652024-11-01T08:32:05.361ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4002 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 61422adb-426e-42fc-a857-efd3795879a0 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
21662024-11-01T08:32:05.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d2cd7ba0-42b2-4549-9b3f-56a3fd560718 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21672024-11-01T08:32:05.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d2cd7ba0-42b2-4549-9b3f-56a3fd560718 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21682024-11-01T08:32:05.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d2cd7ba0-42b2-4549-9b3f-56a3fd560718 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21692024-11-01T08:32:06.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bcd097b0-fc41-4353-aecf-bd2c1607464e roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21702024-11-01T08:32:06.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bcd097b0-fc41-4353-aecf-bd2c1607464e resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21712024-11-01T08:32:06.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bcd097b0-fc41-4353-aecf-bd2c1607464e response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21722024-11-01T08:32:07.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 26fe2848-b45b-447c-9ecb-93df621ed6c0 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21732024-11-01T08:32:07.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 26fe2848-b45b-447c-9ecb-93df621ed6c0 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21742024-11-01T08:32:07.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 26fe2848-b45b-447c-9ecb-93df621ed6c0 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21752024-11-01T08:32:08.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2de83297-10f9-473e-819c-e70013870c10 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21762024-11-01T08:32:08.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2de83297-10f9-473e-819c-e70013870c10 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21772024-11-01T08:32:08.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2de83297-10f9-473e-819c-e70013870c10 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21782024-11-01T08:32:09.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 42e30e1c-f95f-4c7c-808d-c18d8ee19b88 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21792024-11-01T08:32:09.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 42e30e1c-f95f-4c7c-808d-c18d8ee19b88 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21802024-11-01T08:32:09.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 42e30e1c-f95f-4c7c-808d-c18d8ee19b88 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21812024-11-01T08:32:10.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 68b76161-7aa2-434a-b4eb-d2cf3986134d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21822024-11-01T08:32:10.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 68b76161-7aa2-434a-b4eb-d2cf3986134d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21832024-11-01T08:32:10.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 68b76161-7aa2-434a-b4eb-d2cf3986134d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21842024-11-01T08:32:11.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0a9c40f5-9358-4d7c-af53-ecf7db670a2f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21852024-11-01T08:32:11.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0a9c40f5-9358-4d7c-af53-ecf7db670a2f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21862024-11-01T08:32:11.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0a9c40f5-9358-4d7c-af53-ecf7db670a2f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21872024-11-01T08:32:12.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8b0cbd07-70d3-4bb8-9a7a-80189e113088 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21882024-11-01T08:32:12.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8b0cbd07-70d3-4bb8-9a7a-80189e113088 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21892024-11-01T08:32:12.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8b0cbd07-70d3-4bb8-9a7a-80189e113088 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21902024-11-01T08:32:13.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d23de179-2a6b-4fa9-8a6a-dfbcad6824f6 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21912024-11-01T08:32:13.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d23de179-2a6b-4fa9-8a6a-dfbcad6824f6 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21922024-11-01T08:32:13.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d23de179-2a6b-4fa9-8a6a-dfbcad6824f6 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21932024-11-01T08:32:14.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6010dc88-450a-4563-9d93-a90fb2eacfc0 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21942024-11-01T08:32:14.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6010dc88-450a-4563-9d93-a90fb2eacfc0 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21952024-11-01T08:32:14.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6010dc88-450a-4563-9d93-a90fb2eacfc0 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
21962024-11-01T08:32:14.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
21972024-11-01T08:32:14.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21982024-11-01T08:32:14.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21992024-11-01T08:32:14.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
22002024-11-01T08:32:14.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22012024-11-01T08:32:14.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22022024-11-01T08:32:14.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22032024-11-01T08:32:14.699ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22042024-11-01T08:32:14.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22052024-11-01T08:32:14.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22062024-11-01T08:32:14.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22072024-11-01T08:32:14.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22082024-11-01T08:32:14.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22092024-11-01T08:32:14.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22102024-11-01T08:32:14.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22112024-11-01T08:32:14.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
22122024-11-01T08:32:14.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22132024-11-01T08:32:14.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22142024-11-01T08:32:14.717ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
22152024-11-01T08:32:14.717ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.752601ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
22162024-11-01T08:32:14.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.518615ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22172024-11-01T08:32:15.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 478d6b63-90b7-421b-b68d-ae61d4662a30 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22182024-11-01T08:32:15.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 478d6b63-90b7-421b-b68d-ae61d4662a30 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22192024-11-01T08:32:15.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 478d6b63-90b7-421b-b68d-ae61d4662a30 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22202024-11-01T08:32:16.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b5ea76dc-1176-42f5-8fa6-689360a0201f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22212024-11-01T08:32:16.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b5ea76dc-1176-42f5-8fa6-689360a0201f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22222024-11-01T08:32:16.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b5ea76dc-1176-42f5-8fa6-689360a0201f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22232024-11-01T08:32:17.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7c81b142-81de-4c4f-b1c4-c89afd9520d8 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22242024-11-01T08:32:17.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7c81b142-81de-4c4f-b1c4-c89afd9520d8 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22252024-11-01T08:32:17.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7c81b142-81de-4c4f-b1c4-c89afd9520d8 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22262024-11-01T08:32:18.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 09b74870-943a-4412-b1dd-df9ef003a318 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22272024-11-01T08:32:18.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 09b74870-943a-4412-b1dd-df9ef003a318 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22282024-11-01T08:32:18.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 09b74870-943a-4412-b1dd-df9ef003a318 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22292024-11-01T08:32:19.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ad85e72-65f8-4620-89fd-300c36ea213d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22302024-11-01T08:32:19.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ad85e72-65f8-4620-89fd-300c36ea213d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22312024-11-01T08:32:19.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ad85e72-65f8-4620-89fd-300c36ea213d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22322024-11-01T08:32:20.202ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1547 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = b242b913-86ba-4883-bbeb-8334fdc33c27 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
22332024-11-01T08:32:20.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f5a0d7ec-db66-4b23-96ed-84069f55360b roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22342024-11-01T08:32:20.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f5a0d7ec-db66-4b23-96ed-84069f55360b resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22352024-11-01T08:32:20.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f5a0d7ec-db66-4b23-96ed-84069f55360b response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22362024-11-01T08:32:21.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8dab5e21-0e46-42b3-a9e5-ba8be8d179dd roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22372024-11-01T08:32:21.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8dab5e21-0e46-42b3-a9e5-ba8be8d179dd resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22382024-11-01T08:32:21.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8dab5e21-0e46-42b3-a9e5-ba8be8d179dd response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22392024-11-01T08:32:22.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e22ba861-70c0-440c-9b88-d5160e5aac44 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22402024-11-01T08:32:22.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e22ba861-70c0-440c-9b88-d5160e5aac44 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22412024-11-01T08:32:22.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e22ba861-70c0-440c-9b88-d5160e5aac44 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22422024-11-01T08:32:23.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 14a69708-d6da-4b2e-b57a-486f416daa85 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22432024-11-01T08:32:23.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 14a69708-d6da-4b2e-b57a-486f416daa85 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22442024-11-01T08:32:23.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 14a69708-d6da-4b2e-b57a-486f416daa85 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
22452024-11-01T08:32:24.696ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
22462024-11-01T08:32:24.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
22472024-11-01T08:32:24.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22482024-11-01T08:32:24.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22492024-11-01T08:32:24.696ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
22502024-11-01T08:32:24.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
22512024-11-01T08:32:24.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22522024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
22532024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
22542024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22552024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22562024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
22572024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
22582024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22592024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
22602024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22612024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22622024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22632024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22642024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22652024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22662024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22672024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22682024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22692024-11-01T08:32:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22702024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
22712024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
22722024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
22732024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.841\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22742024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.37\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
22752024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22762024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
22772024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
22782024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
22792024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.18\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22802024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22812024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
22822024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.37\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
22832024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22842024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
22852024-11-01T08:32:24.698ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22862024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22872024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22882024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22892024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22902024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22912024-11-01T08:32:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22922024-11-01T08:32:24.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22932024-11-01T08:32:24.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22942024-11-01T08:32:24.700ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.006958ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22952024-11-01T08:32:24.700ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962024-11-01T08:32:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22972024-11-01T08:32:24.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22982024-11-01T08:32:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22992024-11-01T08:32:24.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23002024-11-01T08:32:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23012024-11-01T08:32:24.703ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23022024-11-01T08:32:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23032024-11-01T08:32:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23042024-11-01T08:32:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23052024-11-01T08:32:24.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23062024-11-01T08:32:24.706ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4909, tv_nsec: 550374798 } })
23072024-11-01T08:32:24.706ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23082024-11-01T08:32:24.706ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
23092024-11-01T08:32:24.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23102024-11-01T08:32:24.707ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4909, tv_nsec: 551391193 } })
23112024-11-01T08:32:24.707ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
23122024-11-01T08:32:24.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23132024-11-01T08:32:24.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23142024-11-01T08:32:24.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23152024-11-01T08:32:24.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23162024-11-01T08:32:24.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23172024-11-01T08:32:24.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23182024-11-01T08:32:24.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23192024-11-01T08:32:24.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23202024-11-01T08:32:24.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23212024-11-01T08:32:24.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23222024-11-01T08:32:24.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23232024-11-01T08:32:24.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23242024-11-01T08:32:24.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23252024-11-01T08:32:24.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23262024-11-01T08:32:24.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23272024-11-01T08:32:24.713ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4909, tv_nsec: 557630136 } })
23282024-11-01T08:32:24.713ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23292024-11-01T08:32:24.713ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
23302024-11-01T08:32:24.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23312024-11-01T08:32:24.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23322024-11-01T08:32:24.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23332024-11-01T08:32:24.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23342024-11-01T08:32:24.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23352024-11-01T08:32:24.717ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23362024-11-01T08:32:24.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23372024-11-01T08:32:24.720ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23382024-11-01T08:32:24.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23392024-11-01T08:32:24.731ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23402024-11-01T08:32:24.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23412024-11-01T08:32:24.757ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.189535ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23422024-11-01T08:32:24.758ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23432024-11-01T08:32:24.758ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23442024-11-01T08:32:24.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23452024-11-01T08:32:24.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23462024-11-01T08:32:24.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23472024-11-01T08:32:24.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23482024-11-01T08:32:24.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23492024-11-01T08:32:24.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23502024-11-01T08:32:24.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23512024-11-01T08:32:24.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23522024-11-01T08:32:24.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
23532024-11-01T08:32:24.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23542024-11-01T08:32:24.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23552024-11-01T08:32:24.772ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23562024-11-01T08:32:24.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.89207ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
23572024-11-01T08:32:24.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f7fe3bf0-db6a-428d-8129-f334aa61483d, lookup_type: ById(f7fe3bf0-db6a-428d-8129-f334aa61483d) } result = Ok(())
23582024-11-01T08:32:24.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23592024-11-01T08:32:24.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23602024-11-01T08:32:24.776ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.539245ms iteration = 26 status = 0
23612024-11-01T08:32:24.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
23622024-11-01T08:32:24.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.223549ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
23632024-11-01T08:32:24.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.660736ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23642024-11-01T08:32:24.799ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
23652024-11-01T08:32:24.799ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
23662024-11-01T08:32:24.799ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23672024-11-01T08:32:24.799ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23682024-11-01T08:32:24.799ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d52ca142-2493-4015-a4b5-e32108773aeb", "content-length": "26", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
23692024-11-01T08:32:24.799ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23702024-11-01T08:32:24.799ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "39ddeb7c-8ede-4047-90ec-f77a5e56748c", "content-length": "26", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
23712024-11-01T08:32:24.799ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23722024-11-01T08:32:24.801ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23732024-11-01T08:32:24.801ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23742024-11-01T08:32:24.805ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23752024-11-01T08:32:24.805ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23762024-11-01T08:32:24.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23772024-11-01T08:32:24.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23782024-11-01T08:32:24.809ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 zone_address = fd00:1122:3344:101::2
23792024-11-01T08:32:24.809ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23802024-11-01T08:32:24.809ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1fa3dea-511a-403b-b241-a797cb750997", "content-length": "26", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
23812024-11-01T08:32:24.809ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23822024-11-01T08:32:24.811ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
23832024-11-01T08:32:24.838ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23842024-11-01T08:32:24.838ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23852024-11-01T08:32:24.838ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.299588ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23862024-11-01T08:32:24.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23872024-11-01T08:32:24.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23882024-11-01T08:32:24.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23892024-11-01T08:32:24.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23902024-11-01T08:32:24.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23912024-11-01T08:32:24.855ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.897505ms iteration = 30 status = {"physical_disks_added":0}
23922024-11-01T08:32:24.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23932024-11-01T08:32:24.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23942024-11-01T08:32:24.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23952024-11-01T08:32:24.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23962024-11-01T08:32:24.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23972024-11-01T08:32:24.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23982024-11-01T08:32:24.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23992024-11-01T08:32:24.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c731814b-e212-4479-b8f8-2d2f8f0e60e2 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24002024-11-01T08:32:24.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c731814b-e212-4479-b8f8-2d2f8f0e60e2 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24012024-11-01T08:32:24.902ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 205.88011ms iteration = 26 status = {}
24022024-11-01T08:32:24.906ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24032024-11-01T08:32:24.906ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "58d1cade-854d-462e-9a77-1f38eb1c8d2c", "content-length": "2", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
24042024-11-01T08:32:24.907ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24052024-11-01T08:32:24.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24062024-11-01T08:32:24.909ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24072024-11-01T08:32:24.909ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24082024-11-01T08:32:24.909ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b62b3c47-8a66-412f-bc64-dfcf36bd2404", "content-length": "372", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
24092024-11-01T08:32:24.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24102024-11-01T08:32:24.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24112024-11-01T08:32:24.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c731814b-e212-4479-b8f8-2d2f8f0e60e2 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24122024-11-01T08:32:24.912ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 215.422004ms iteration = 26 status = null
24132024-11-01T08:32:24.925ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
24142024-11-01T08:32:24.925ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24152024-11-01T08:32:24.925ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "74be0d64-a568-43fe-b2bf-1a150687d135", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
24162024-11-01T08:32:24.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24172024-11-01T08:32:24.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24182024-11-01T08:32:24.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24192024-11-01T08:32:24.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24202024-11-01T08:32:24.951ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24212024-11-01T08:32:24.952ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd9b5d31-bd53-4e9c-ae91-3aefb23184f9", "content-length": "691", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
24222024-11-01T08:32:24.952ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
24232024-11-01T08:32:24.952ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
24242024-11-01T08:32:24.952ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
24252024-11-01T08:32:24.954ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 257.412927ms iteration = 27 status = {}
24262024-11-01T08:32:24.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24272024-11-01T08:32:24.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24282024-11-01T08:32:24.967ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24292024-11-01T08:32:24.967ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24302024-11-01T08:32:24.967ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b4b26804-3f38-4391-bbd8-a6fdbf0b4178", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
24312024-11-01T08:32:24.970ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 272.153408ms iteration = 28 status = {}
24322024-11-01T08:32:25.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24332024-11-01T08:32:25.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24342024-11-01T08:32:25.003ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e2aedfd9-3b4d-40ab-920a-0ddf803678fe, rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a0c3e848-f136-4ae5-b986-95beae550c75) } rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
24352024-11-01T08:32:25.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24362024-11-01T08:32:25.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24372024-11-01T08:32:25.013ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24382024-11-01T08:32:25.014ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "da2223e0-dad2-4818-9ba3-c3c4a693b3ff", "content-length": "121", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
24392024-11-01T08:32:25.014ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
24402024-11-01T08:32:25.014ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a0c3e848-f136-4ae5-b986-95beae550c75
24412024-11-01T08:32:25.014ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24422024-11-01T08:32:25.014ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24432024-11-01T08:32:25.014ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24442024-11-01T08:32:25.014ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24452024-11-01T08:32:25.014ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24462024-11-01T08:32:25.014ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24472024-11-01T08:32:25.014ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24482024-11-01T08:32:25.014ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24492024-11-01T08:32:25.015ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
24502024-11-01T08:32:25.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24512024-11-01T08:32:25.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24522024-11-01T08:32:25.017ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24532024-11-01T08:32:25.017ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f639a9bc-f500-4f08-a0da-1183a95e6c84", "content-length": "2", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
24542024-11-01T08:32:25.017ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24552024-11-01T08:32:25.017ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "54aaa3de-1312-413b-a794-cf87aae782e0", "content-length": "52", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
24562024-11-01T08:32:25.017ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
24572024-11-01T08:32:25.017ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24582024-11-01T08:32:25.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = aeb661ba-4106-4a60-84f1-5a7c2f1f4a0e roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
24592024-11-01T08:32:25.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = aeb661ba-4106-4a60-84f1-5a7c2f1f4a0e resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
24602024-11-01T08:32:25.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = aeb661ba-4106-4a60-84f1-5a7c2f1f4a0e response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
24612024-11-01T08:32:25.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = f5f54d98-fa20-44d5-b159-c72be67918c3 roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
24622024-11-01T08:32:25.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = f5f54d98-fa20-44d5-b159-c72be67918c3 resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
24632024-11-01T08:32:25.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = f5f54d98-fa20-44d5-b159-c72be67918c3 response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
24642024-11-01T08:32:25.215ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f088bbfa-59f1-4c27-8579-d6abcc1fb833", "date": "Fri, 01 Nov 2024 08:32:25 GMT"} })
24652024-11-01T08:32:25.215ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch = Switch0
24662024-11-01T08:32:25.215ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24672024-11-01T08:32:25.215ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a2a79d4-55a9-427b-b9b3-8c44b0b8c239", "content-length": "669", "date": "Fri, 01 Nov 2024 08:32:24 GMT"} })
24682024-11-01T08:32:25.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24692024-11-01T08:32:25.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24702024-11-01T08:32:25.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24712024-11-01T08:32:25.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24722024-11-01T08:32:25.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24732024-11-01T08:32:25.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24742024-11-01T08:32:25.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24752024-11-01T08:32:25.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24762024-11-01T08:32:25.231ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 534.460164ms iteration = 26 status = {}
24772024-11-01T08:32:25.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c08aae44-aa81-469e-9443-3a58d7ad1c7c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24782024-11-01T08:32:25.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c08aae44-aa81-469e-9443-3a58d7ad1c7c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24792024-11-01T08:32:25.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c08aae44-aa81-469e-9443-3a58d7ad1c7c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24802024-11-01T08:32:26.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 031e881e-286e-4b23-aa36-5dc9b0daecdd roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24812024-11-01T08:32:26.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 031e881e-286e-4b23-aa36-5dc9b0daecdd resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24822024-11-01T08:32:26.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 031e881e-286e-4b23-aa36-5dc9b0daecdd response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24832024-11-01T08:32:27.428ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44800
24842024-11-01T08:32:27.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44800 req_id = 03201325-e830-48a9-bb2f-64b6917358bd roles = RoleSet { roles: {} } uri = /metrics/producers
24852024-11-01T08:32:27.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44800 req_id = 03201325-e830-48a9-bb2f-64b6917358bd resource = Database result = Ok(()) uri = /metrics/producers
24862024-11-01T08:32:27.474ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = fb204559-5544-48a2-aa69-220d2ab92899
24872024-11-01T08:32:27.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45368 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44800 req_id = 03201325-e830-48a9-bb2f-64b6917358bd response_code = 201 uri = /metrics/producers
24882024-11-01T08:32:27.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ed4d1ff-3ade-4b67-a995-16dac65f8255 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24892024-11-01T08:32:27.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ed4d1ff-3ade-4b67-a995-16dac65f8255 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24902024-11-01T08:32:27.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ed4d1ff-3ade-4b67-a995-16dac65f8255 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24912024-11-01T08:32:29.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cb56a809-00df-403b-8df2-86a9535cf073 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24922024-11-01T08:32:29.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cb56a809-00df-403b-8df2-86a9535cf073 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24932024-11-01T08:32:29.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cb56a809-00df-403b-8df2-86a9535cf073 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24942024-11-01T08:32:30.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 617aa568-87c5-4a99-b284-3add31508fe7 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24952024-11-01T08:32:30.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 617aa568-87c5-4a99-b284-3add31508fe7 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24962024-11-01T08:32:30.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 617aa568-87c5-4a99-b284-3add31508fe7 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24972024-11-01T08:32:31.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 29e0d689-6ac1-4d66-85b8-aac4281b0b34 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24982024-11-01T08:32:31.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 29e0d689-6ac1-4d66-85b8-aac4281b0b34 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
24992024-11-01T08:32:31.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 29e0d689-6ac1-4d66-85b8-aac4281b0b34 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25002024-11-01T08:32:31.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 9ab20e5e-1bde-4f48-a3b1-374fb6136dec roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
25012024-11-01T08:32:31.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 9ab20e5e-1bde-4f48-a3b1-374fb6136dec resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
25022024-11-01T08:32:31.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 9ab20e5e-1bde-4f48-a3b1-374fb6136dec response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
25032024-11-01T08:32:32.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6d62f77d-e19e-44ba-bfec-6e591f752852 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25042024-11-01T08:32:32.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6d62f77d-e19e-44ba-bfec-6e591f752852 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25052024-11-01T08:32:32.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6d62f77d-e19e-44ba-bfec-6e591f752852 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25062024-11-01T08:32:32.551ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44770
25072024-11-01T08:32:32.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44770 req_id = 83a0761b-f5a9-4615-843a-a00dca3ca466 roles = RoleSet { roles: {} } uri = /metrics/producers
25082024-11-01T08:32:32.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44770 req_id = 83a0761b-f5a9-4615-843a-a00dca3ca466 resource = Database result = Ok(()) uri = /metrics/producers
25092024-11-01T08:32:32.589ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = 2bd8d4c6-9800-41ac-b72e-4afab6fc2f46
25102024-11-01T08:32:32.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37835 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44770 req_id = 83a0761b-f5a9-4615-843a-a00dca3ca466 response_code = 201 uri = /metrics/producers
25112024-11-01T08:32:33.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cd50a9f7-e5bf-4c9c-9043-ce6847da133f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25122024-11-01T08:32:33.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cd50a9f7-e5bf-4c9c-9043-ce6847da133f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25132024-11-01T08:32:33.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cd50a9f7-e5bf-4c9c-9043-ce6847da133f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25142024-11-01T08:32:34.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1d532201-3635-4a77-921a-9b8bc30a9172 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25152024-11-01T08:32:34.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1d532201-3635-4a77-921a-9b8bc30a9172 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25162024-11-01T08:32:34.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1d532201-3635-4a77-921a-9b8bc30a9172 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25172024-11-01T08:32:34.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
25182024-11-01T08:32:34.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25192024-11-01T08:32:34.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25202024-11-01T08:32:34.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
25212024-11-01T08:32:34.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25222024-11-01T08:32:34.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25232024-11-01T08:32:34.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25242024-11-01T08:32:34.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25252024-11-01T08:32:34.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25262024-11-01T08:32:34.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25272024-11-01T08:32:34.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25282024-11-01T08:32:34.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25292024-11-01T08:32:34.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25302024-11-01T08:32:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
25312024-11-01T08:32:34.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25322024-11-01T08:32:34.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25332024-11-01T08:32:34.720ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
25342024-11-01T08:32:34.720ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.036841ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
25352024-11-01T08:32:34.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25362024-11-01T08:32:34.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25372024-11-01T08:32:34.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.197096ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25382024-11-01T08:32:35.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e1c1fb4e-fda0-49cc-8c04-aa922a0c9480 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25392024-11-01T08:32:35.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e1c1fb4e-fda0-49cc-8c04-aa922a0c9480 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25402024-11-01T08:32:35.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e1c1fb4e-fda0-49cc-8c04-aa922a0c9480 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25412024-11-01T08:32:35.202ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 435e1eff-b6d0-4409-958e-eac1ba3e27e1 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
25422024-11-01T08:32:35.642ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:62420
25432024-11-01T08:32:35.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62420 req_id = 87aefffe-84a0-4677-8b44-0a834d2c36fc roles = RoleSet { roles: {} } uri = /metrics/producers
25442024-11-01T08:32:35.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62420 req_id = 87aefffe-84a0-4677-8b44-0a834d2c36fc resource = Database result = Ok(()) uri = /metrics/producers
25452024-11-01T08:32:35.650ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = 3735dd72-b7e1-429d-8105-2c95027a9081
25462024-11-01T08:32:35.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7777 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62420 req_id = 87aefffe-84a0-4677-8b44-0a834d2c36fc response_code = 201 uri = /metrics/producers
25472024-11-01T08:32:36.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e52f3ffb-8ae2-438d-85cd-2921dff90f7f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25482024-11-01T08:32:36.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e52f3ffb-8ae2-438d-85cd-2921dff90f7f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25492024-11-01T08:32:36.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e52f3ffb-8ae2-438d-85cd-2921dff90f7f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25502024-11-01T08:32:37.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3c01f5ce-ecee-4901-9e81-b34c6ba8d6c0 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25512024-11-01T08:32:37.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3c01f5ce-ecee-4901-9e81-b34c6ba8d6c0 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25522024-11-01T08:32:37.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3c01f5ce-ecee-4901-9e81-b34c6ba8d6c0 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25532024-11-01T08:32:38.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b5a6eb60-59da-4d30-bf96-089bb91217ad roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25542024-11-01T08:32:38.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b5a6eb60-59da-4d30-bf96-089bb91217ad resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25552024-11-01T08:32:38.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b5a6eb60-59da-4d30-bf96-089bb91217ad response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25562024-11-01T08:32:39.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dd8f10bd-79a1-4fe7-922d-2c1993377e69 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25572024-11-01T08:32:39.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dd8f10bd-79a1-4fe7-922d-2c1993377e69 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25582024-11-01T08:32:39.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dd8f10bd-79a1-4fe7-922d-2c1993377e69 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25592024-11-01T08:32:40.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = be832b1d-fe13-4835-a7bd-c102dc4f20cc roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25602024-11-01T08:32:40.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = be832b1d-fe13-4835-a7bd-c102dc4f20cc resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25612024-11-01T08:32:40.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = be832b1d-fe13-4835-a7bd-c102dc4f20cc response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25622024-11-01T08:32:41.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 91b18d11-9637-4d8d-aa42-058d7d2e688c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25632024-11-01T08:32:41.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 91b18d11-9637-4d8d-aa42-058d7d2e688c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25642024-11-01T08:32:41.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 91b18d11-9637-4d8d-aa42-058d7d2e688c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25652024-11-01T08:32:41.749ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33336
25662024-11-01T08:32:41.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33336 req_id = ee1cbd6a-6f12-495e-8c47-ae14914853ec roles = RoleSet { roles: {} } uri = /metrics/producers
25672024-11-01T08:32:41.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33336 req_id = ee1cbd6a-6f12-495e-8c47-ae14914853ec resource = Database result = Ok(()) uri = /metrics/producers
25682024-11-01T08:32:41.786ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = a222b9b7-131e-465b-8e67-8290950a717e
25692024-11-01T08:32:41.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36841 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33336 req_id = ee1cbd6a-6f12-495e-8c47-ae14914853ec response_code = 201 uri = /metrics/producers
25702024-11-01T08:32:42.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6657ea61-6303-4fba-af74-347d93f6e62b roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25712024-11-01T08:32:42.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6657ea61-6303-4fba-af74-347d93f6e62b resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25722024-11-01T08:32:42.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6657ea61-6303-4fba-af74-347d93f6e62b response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25732024-11-01T08:32:43.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5190c8c6-c1dc-4e55-b561-c65ff1598360 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25742024-11-01T08:32:43.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5190c8c6-c1dc-4e55-b561-c65ff1598360 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25752024-11-01T08:32:43.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5190c8c6-c1dc-4e55-b561-c65ff1598360 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25762024-11-01T08:32:43.799ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44913
25772024-11-01T08:32:43.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44913 req_id = beb75804-4aa3-4d91-8849-02a07e853b7b roles = RoleSet { roles: {} } uri = /metrics/producers
25782024-11-01T08:32:43.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44913 req_id = beb75804-4aa3-4d91-8849-02a07e853b7b resource = Database result = Ok(()) uri = /metrics/producers
25792024-11-01T08:32:43.808ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25802024-11-01T08:32:43.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8486 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44913 req_id = beb75804-4aa3-4d91-8849-02a07e853b7b response_code = 201 uri = /metrics/producers
25812024-11-01T08:32:44.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e3214cdf-2938-4f22-9579-1160df84351c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25822024-11-01T08:32:44.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e3214cdf-2938-4f22-9579-1160df84351c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25832024-11-01T08:32:44.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e3214cdf-2938-4f22-9579-1160df84351c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
25842024-11-01T08:32:44.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
25852024-11-01T08:32:44.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25862024-11-01T08:32:44.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25872024-11-01T08:32:44.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
25882024-11-01T08:32:44.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25892024-11-01T08:32:44.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25902024-11-01T08:32:44.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25912024-11-01T08:32:44.699ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25922024-11-01T08:32:44.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25932024-11-01T08:32:44.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.258624ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25942024-11-01T08:32:44.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25952024-11-01T08:32:44.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25962024-11-01T08:32:44.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25972024-11-01T08:32:44.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25982024-11-01T08:32:44.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25992024-11-01T08:32:44.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26002024-11-01T08:32:44.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
26012024-11-01T08:32:44.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26022024-11-01T08:32:44.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26032024-11-01T08:32:44.720ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
26042024-11-01T08:32:44.720ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.683733ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
26052024-11-01T08:32:45.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a80dc9d4-eb4d-4483-a0cc-1eed8eb64202 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26062024-11-01T08:32:45.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a80dc9d4-eb4d-4483-a0cc-1eed8eb64202 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26072024-11-01T08:32:45.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a80dc9d4-eb4d-4483-a0cc-1eed8eb64202 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26082024-11-01T08:32:46.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7c73b179-2051-43eb-9d36-c8b2a252481a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26092024-11-01T08:32:46.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7c73b179-2051-43eb-9d36-c8b2a252481a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26102024-11-01T08:32:46.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7c73b179-2051-43eb-9d36-c8b2a252481a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26112024-11-01T08:32:46.454ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47991
26122024-11-01T08:32:46.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47991 req_id = 3566f86d-22a6-4059-82df-04130cdc95af roles = RoleSet { roles: {} } uri = /metrics/producers
26132024-11-01T08:32:46.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47991 req_id = 3566f86d-22a6-4059-82df-04130cdc95af resource = Database result = Ok(()) uri = /metrics/producers
26142024-11-01T08:32:46.462ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = 71e16aab-fabd-48da-9122-0ddfcab1e2c2
26152024-11-01T08:32:46.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8026 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47991 req_id = 3566f86d-22a6-4059-82df-04130cdc95af response_code = 201 uri = /metrics/producers
26162024-11-01T08:32:47.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 86f540dd-2059-4787-a1f6-6c406a63d84b roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26172024-11-01T08:32:47.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 86f540dd-2059-4787-a1f6-6c406a63d84b resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26182024-11-01T08:32:47.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 86f540dd-2059-4787-a1f6-6c406a63d84b response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26192024-11-01T08:32:48.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 07829691-1afc-47a3-b939-80c9ad1caba0 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26202024-11-01T08:32:48.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 07829691-1afc-47a3-b939-80c9ad1caba0 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26212024-11-01T08:32:48.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 07829691-1afc-47a3-b939-80c9ad1caba0 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26222024-11-01T08:32:49.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 77727234-413c-4c83-8e80-e1cbb4958f98 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26232024-11-01T08:32:49.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 77727234-413c-4c83-8e80-e1cbb4958f98 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26242024-11-01T08:32:49.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 77727234-413c-4c83-8e80-e1cbb4958f98 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26252024-11-01T08:32:50.202ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 0e71a34a-3e46-41b9-9458-c2eacb92c495 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
26262024-11-01T08:32:50.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 96271922-eac1-4913-aed8-627b254eaf0b roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26272024-11-01T08:32:50.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 96271922-eac1-4913-aed8-627b254eaf0b resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26282024-11-01T08:32:50.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 96271922-eac1-4913-aed8-627b254eaf0b response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26292024-11-01T08:32:51.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 96ce8066-baaf-427a-9f36-abf9499ff3b3 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26302024-11-01T08:32:51.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 96ce8066-baaf-427a-9f36-abf9499ff3b3 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26312024-11-01T08:32:51.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 96ce8066-baaf-427a-9f36-abf9499ff3b3 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26322024-11-01T08:32:52.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0b609fca-1879-4487-b959-e3dd70aee8a6 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26332024-11-01T08:32:52.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0b609fca-1879-4487-b959-e3dd70aee8a6 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26342024-11-01T08:32:52.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0b609fca-1879-4487-b959-e3dd70aee8a6 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26352024-11-01T08:32:53.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fadf84a9-08d1-43ba-8f18-d3005ed938ba roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26362024-11-01T08:32:53.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fadf84a9-08d1-43ba-8f18-d3005ed938ba resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26372024-11-01T08:32:53.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fadf84a9-08d1-43ba-8f18-d3005ed938ba response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26382024-11-01T08:32:54.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cfbeede4-30d1-42ee-952f-21bbeff6e5fd roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26392024-11-01T08:32:54.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cfbeede4-30d1-42ee-952f-21bbeff6e5fd resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26402024-11-01T08:32:54.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cfbeede4-30d1-42ee-952f-21bbeff6e5fd response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
26412024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
26422024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
26432024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26442024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
26452024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26462024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26472024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
26482024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
26492024-11-01T08:32:54.696ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 08:22:54.696232174 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
26502024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
26512024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
26522024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26532024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
26542024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
26552024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26562024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
26572024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
26582024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
26592024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
26602024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26612024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26622024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
26632024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
26642024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
26652024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26662024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
26672024-11-01T08:32:54.696ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876
26682024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.671\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876"}
26692024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
26702024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
26712024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26722024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
26732024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26742024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
26752024-11-01T08:32:54.696ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
26762024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26772024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
26782024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26792024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26802024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26812024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26822024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26832024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26842024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
26852024-11-01T08:32:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26862024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26872024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
26882024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26892024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
26902024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
26912024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
26922024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26932024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26942024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.57\u{b5}s iteration = 27 status = {"errors":[],"records_set_to_done":[]}
26952024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26962024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
26972024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
26982024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26992024-11-01T08:32:54.697ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27002024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
27012024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
27022024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27032024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27042024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
27052024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27062024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
27072024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
27082024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
27092024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.24\u{b5}s iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27102024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
27112024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
27122024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.7\u{b5}s iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
27132024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.77\u{b5}s iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27142024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27152024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27162024-11-01T08:32:54.697ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7a6aafb-271b-4c58-a4ee-a120d4fe517b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5a9d05d-8509-4c10-96d8-97ac84fede0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5a9d05d-8509-4c10-96d8-97ac84fede0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 4939, tv_nsec: 541638170 } })
27172024-11-01T08:32:54.697ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4bab0cba-a00a-4740-88aa-0040e016028d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("726c5ac9-9d5f-4339-8159-0a04793fd959.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 4939, tv_nsec: 541644830 } })
27182024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27192024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27202024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
27212024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
27222024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27232024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27242024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27252024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
27262024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.291532ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
27272024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
27282024-11-01T08:32:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.399764ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
27292024-11-01T08:32:54.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27302024-11-01T08:32:54.700ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.0953ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27312024-11-01T08:32:54.701ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4939, tv_nsec: 545438383 } })
27322024-11-01T08:32:54.701ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4939, tv_nsec: 545619767 } })
27332024-11-01T08:32:54.701ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
27342024-11-01T08:32:54.701ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
27352024-11-01T08:32:54.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27362024-11-01T08:32:54.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27372024-11-01T08:32:54.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27382024-11-01T08:32:54.704ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 08:22:54.696232174 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
27392024-11-01T08:32:54.704ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.865834ms iteration = 14 status = {"expiration":"2024-11-01T08:22:54.696232174Z","pruned":[]}
27402024-11-01T08:32:54.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27412024-11-01T08:32:54.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27422024-11-01T08:32:54.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27432024-11-01T08:32:54.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27442024-11-01T08:32:54.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27452024-11-01T08:32:54.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27462024-11-01T08:32:54.706ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27472024-11-01T08:32:54.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27482024-11-01T08:32:54.708ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27492024-11-01T08:32:54.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27502024-11-01T08:32:54.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27512024-11-01T08:32:54.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27522024-11-01T08:32:54.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27532024-11-01T08:32:54.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27542024-11-01T08:32:54.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27552024-11-01T08:32:54.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
27562024-11-01T08:32:54.710ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27572024-11-01T08:32:54.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27582024-11-01T08:32:54.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27592024-11-01T08:32:54.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27602024-11-01T08:32:54.713ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.208579ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
27612024-11-01T08:32:54.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27622024-11-01T08:32:54.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27632024-11-01T08:32:54.714ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
27642024-11-01T08:32:54.714ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
27652024-11-01T08:32:54.714ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.658844ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
27662024-11-01T08:32:54.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27672024-11-01T08:32:54.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27682024-11-01T08:32:54.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27692024-11-01T08:32:54.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27702024-11-01T08:32:54.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27712024-11-01T08:32:54.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27722024-11-01T08:32:54.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27732024-11-01T08:32:54.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27742024-11-01T08:32:54.720ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27752024-11-01T08:32:54.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27762024-11-01T08:32:54.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27772024-11-01T08:32:54.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27782024-11-01T08:32:54.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27792024-11-01T08:32:54.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27802024-11-01T08:32:54.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27812024-11-01T08:32:54.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27822024-11-01T08:32:54.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27832024-11-01T08:32:54.728ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27842024-11-01T08:32:54.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27852024-11-01T08:32:54.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27862024-11-01T08:32:54.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27872024-11-01T08:32:54.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
27882024-11-01T08:32:54.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27892024-11-01T08:32:54.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27902024-11-01T08:32:54.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27912024-11-01T08:32:54.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27922024-11-01T08:32:54.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27932024-11-01T08:32:54.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27942024-11-01T08:32:54.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27952024-11-01T08:32:54.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27962024-11-01T08:32:54.771ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4939, tv_nsec: 615697430 } })
27972024-11-01T08:32:54.771ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
27982024-11-01T08:32:54.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27992024-11-01T08:32:54.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28002024-11-01T08:32:54.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28012024-11-01T08:32:54.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28022024-11-01T08:32:54.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28032024-11-01T08:32:54.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28042024-11-01T08:32:54.777ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
28052024-11-01T08:32:54.777ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
28062024-11-01T08:32:54.777ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
28072024-11-01T08:32:54.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28082024-11-01T08:32:54.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28092024-11-01T08:32:54.778ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28102024-11-01T08:32:54.778ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28112024-11-01T08:32:54.778ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28122024-11-01T08:32:54.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28132024-11-01T08:32:54.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28142024-11-01T08:32:54.780ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28152024-11-01T08:32:54.781ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28162024-11-01T08:32:54.781ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28172024-11-01T08:32:54.781ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28182024-11-01T08:32:54.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28192024-11-01T08:32:54.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28202024-11-01T08:32:54.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28212024-11-01T08:32:54.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28222024-11-01T08:32:54.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28232024-11-01T08:32:54.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28242024-11-01T08:32:54.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28252024-11-01T08:32:54.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28262024-11-01T08:32:54.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28272024-11-01T08:32:54.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28282024-11-01T08:32:54.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28292024-11-01T08:32:54.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28302024-11-01T08:32:54.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
28312024-11-01T08:32:54.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28322024-11-01T08:32:54.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28332024-11-01T08:32:54.791ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
28342024-11-01T08:32:54.791ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
28352024-11-01T08:32:54.791ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
28362024-11-01T08:32:54.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28372024-11-01T08:32:54.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28382024-11-01T08:32:54.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.760988ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28392024-11-01T08:32:54.794ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
28402024-11-01T08:32:54.794ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
28412024-11-01T08:32:54.794ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 98.403239ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
28422024-11-01T08:32:54.800ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28432024-11-01T08:32:54.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28442024-11-01T08:32:54.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28452024-11-01T08:32:54.803ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
28462024-11-01T08:32:54.803ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.524583ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
28472024-11-01T08:32:54.804ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28482024-11-01T08:32:54.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28492024-11-01T08:32:54.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28502024-11-01T08:32:54.813ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
28512024-11-01T08:32:54.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28522024-11-01T08:32:54.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28532024-11-01T08:32:54.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28542024-11-01T08:32:54.828ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
28552024-11-01T08:32:54.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 131.43078ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28562024-11-01T08:32:54.828ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 131.411869ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
28572024-11-01T08:32:54.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f7fe3bf0-db6a-428d-8129-f334aa61483d, lookup_type: ById(f7fe3bf0-db6a-428d-8129-f334aa61483d) } result = Ok(())
28582024-11-01T08:32:54.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28592024-11-01T08:32:54.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28602024-11-01T08:32:54.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28612024-11-01T08:32:54.836ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 139.883028ms iteration = 27 status = 0
28622024-11-01T08:32:54.836ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28632024-11-01T08:32:54.836ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28642024-11-01T08:32:54.836ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 139.776075ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28652024-11-01T08:32:54.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28662024-11-01T08:32:54.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28672024-11-01T08:32:54.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28682024-11-01T08:32:54.840ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
28692024-11-01T08:32:54.840ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1a6211e1-bd03-4044-93cd-6a5868005875 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
28702024-11-01T08:32:54.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28712024-11-01T08:32:54.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28722024-11-01T08:32:54.840ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 144.296266ms iteration = 31 status = {"physical_disks_added":0}
28732024-11-01T08:32:54.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28742024-11-01T08:32:54.842ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
28752024-11-01T08:32:54.842ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b06c736-f13d-44f4-95f3-1c25c945a356 dns_zone_name = oxide.test found_so_far = 0 version = 2
28762024-11-01T08:32:54.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28772024-11-01T08:32:54.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28782024-11-01T08:32:54.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28792024-11-01T08:32:54.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28802024-11-01T08:32:54.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28812024-11-01T08:32:54.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28822024-11-01T08:32:54.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28832024-11-01T08:32:54.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28842024-11-01T08:32:54.850ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28852024-11-01T08:32:54.850ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 153.856411ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28862024-11-01T08:32:54.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28872024-11-01T08:32:54.854ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1a6211e1-bd03-4044-93cd-6a5868005875 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
28882024-11-01T08:32:54.854ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
28892024-11-01T08:32:54.854ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 08:20:37.196977 UTC dns_group = internal generation = 1
28902024-11-01T08:32:54.854ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 157.699646ms iteration = 15 status = {"generation":1}
28912024-11-01T08:32:54.856ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
28922024-11-01T08:32:54.856ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28932024-11-01T08:32:54.857ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc3549a6-aee0-4356-b925-cbfe7d68e4f9", "content-length": "26", "date": "Fri, 01 Nov 2024 08:32:54 GMT"} })
28942024-11-01T08:32:54.857ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28952024-11-01T08:32:54.859ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28962024-11-01T08:32:54.865ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T08:19:51.214273Z, time_modified: 2024-11-01T08:19:51.214273Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f8c93fa7-6555-4906-9ff7-39adb002e287, db_silo: Silo { identity: SiloIdentity { id: f8c93fa7-6555-4906-9ff7-39adb002e287, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T08:20:37.795553Z, time_modified: 2024-11-01T08:20:37.795553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f8c93fa7-6555-4906-9ff7-39adb002e287, db_silo: Silo { identity: SiloIdentity { id: f8c93fa7-6555-4906-9ff7-39adb002e287, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T08:20:37.795553Z, time_modified: 2024-11-01T08:20:37.795553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372" }] }) }
28972024-11-01T08:32:54.865ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 169.320251ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f8c93fa7-6555-4906-9ff7-39adb002e287","tls_certs":["03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372"]}},"default_endpoint":{"silo_id":"f8c93fa7-6555-4906-9ff7-39adb002e287","tls_certs":["03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
28982024-11-01T08:32:54.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28992024-11-01T08:32:54.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29002024-11-01T08:32:54.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 zone_address = fd00:1122:3344:101::2
29012024-11-01T08:32:54.937ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29022024-11-01T08:32:54.937ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f592c19-cab7-44e6-88f9-5b5be3d517c9", "content-length": "26", "date": "Fri, 01 Nov 2024 08:32:54 GMT"} })
29032024-11-01T08:32:54.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29042024-11-01T08:32:54.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
29052024-11-01T08:32:54.946ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
29062024-11-01T08:32:55.010ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29072024-11-01T08:32:55.010ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29082024-11-01T08:32:55.011ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8da45a27-ebbb-4f26-bf96-d87de45c78d8", "content-length": "372", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} })
29092024-11-01T08:32:55.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29102024-11-01T08:32:55.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29112024-11-01T08:32:55.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29122024-11-01T08:32:55.014ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b06c736-f13d-44f4-95f3-1c25c945a356 dns_zone_name = oxide.test found_so_far = 1 version = 2
29132024-11-01T08:32:55.014ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
29142024-11-01T08:32:55.014ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 08:20:37.945638 UTC dns_group = external generation = 2
29152024-11-01T08:32:55.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 317.915213ms iteration = 15 status = {"generation":2}
29162024-11-01T08:32:55.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29172024-11-01T08:32:55.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29182024-11-01T08:32:55.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29192024-11-01T08:32:55.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29202024-11-01T08:32:55.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29212024-11-01T08:32:55.022ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29222024-11-01T08:32:55.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29232024-11-01T08:32:55.045ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
29242024-11-01T08:32:55.046ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29252024-11-01T08:32:55.046ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b2487f3-d2b6-404e-b584-72fdbd0f0911", "content-length": "26", "date": "Fri, 01 Nov 2024 08:32:54 GMT"} })
29262024-11-01T08:32:55.046ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29272024-11-01T08:32:55.049ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29282024-11-01T08:32:55.071ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29292024-11-01T08:32:55.072ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29302024-11-01T08:32:55.072ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dba969ad-3dfc-424e-9204-45f4cfd27480", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} })
29312024-11-01T08:32:55.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29322024-11-01T08:32:55.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29332024-11-01T08:32:55.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29342024-11-01T08:32:55.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29352024-11-01T08:32:55.107ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
29362024-11-01T08:32:55.107ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "22ea5cd8-53c4-4590-aacf-c9f553eca70c", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29372024-11-01T08:32:55.107ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29382024-11-01T08:32:55.109ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c5bd7963-0e71-4f8e-87ed-512efc619c26", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29392024-11-01T08:32:55.109ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29402024-11-01T08:32:55.111ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29412024-11-01T08:32:55.111ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 415.098071ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
29422024-11-01T08:32:55.138ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 442.586577ms iteration = 27 status = {}
29432024-11-01T08:32:55.156ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
29442024-11-01T08:32:55.190ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29452024-11-01T08:32:55.191ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1be93bc7-6df7-48c2-8e43-2adfd4fcc6b4", "content-length": "2", "date": "Fri, 01 Nov 2024 08:32:54 GMT"} })
29462024-11-01T08:32:55.193ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29472024-11-01T08:32:55.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 5f38599e-6ade-4189-9747-d41a7f923799 roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
29482024-11-01T08:32:55.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29492024-11-01T08:32:55.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 5f38599e-6ade-4189-9747-d41a7f923799 resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
29502024-11-01T08:32:55.252ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
29512024-11-01T08:32:55.252ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b3658db2-c972-4bb0-bbd5-c158565b50aa", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29522024-11-01T08:32:55.253ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29532024-11-01T08:32:55.254ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "176f69c5-6bc6-4551-aeb3-fdba8c9bfddb", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29542024-11-01T08:32:55.254ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29552024-11-01T08:32:55.255ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c3f752a0-cedf-41fc-b5d4-1be2bd081515", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29562024-11-01T08:32:55.255ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29572024-11-01T08:32:55.257ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29582024-11-01T08:32:55.257ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 561.096259ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
29592024-11-01T08:32:55.274ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29602024-11-01T08:32:55.276ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 580.65319ms iteration = 27 status = null
29612024-11-01T08:32:55.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29622024-11-01T08:32:55.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29632024-11-01T08:32:55.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 5f38599e-6ade-4189-9747-d41a7f923799 response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
29642024-11-01T08:32:55.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 35849903-2526-4d2e-b32e-ae547ff2117a roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
29652024-11-01T08:32:55.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 35849903-2526-4d2e-b32e-ae547ff2117a resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
29662024-11-01T08:32:55.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 35849903-2526-4d2e-b32e-ae547ff2117a response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
29672024-11-01T08:32:55.281ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29682024-11-01T08:32:55.281ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29692024-11-01T08:32:55.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29702024-11-01T08:32:55.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29712024-11-01T08:32:55.316ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e2aedfd9-3b4d-40ab-920a-0ddf803678fe, rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a0c3e848-f136-4ae5-b986-95beae550c75) } rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
29722024-11-01T08:32:55.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29732024-11-01T08:32:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29742024-11-01T08:32:55.325ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29752024-11-01T08:32:55.325ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "68a7f326-4ba1-4723-a5a4-d2216c661736", "content-length": "121", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} })
29762024-11-01T08:32:55.325ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
29772024-11-01T08:32:55.325ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a0c3e848-f136-4ae5-b986-95beae550c75
29782024-11-01T08:32:55.326ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29792024-11-01T08:32:55.326ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29802024-11-01T08:32:55.326ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29812024-11-01T08:32:55.326ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29822024-11-01T08:32:55.326ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29832024-11-01T08:32:55.326ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29842024-11-01T08:32:55.326ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29852024-11-01T08:32:55.326ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29862024-11-01T08:32:55.326ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
29872024-11-01T08:32:55.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29882024-11-01T08:32:55.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29892024-11-01T08:32:55.328ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29902024-11-01T08:32:55.329ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "39c23879-55fc-4871-a28d-0f1e56736a73", "content-length": "2", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} })
29912024-11-01T08:32:55.329ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29922024-11-01T08:32:55.329ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa0b1fd2-3a8a-4b98-aeba-4caae2b0d0e0", "content-length": "52", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} })
29932024-11-01T08:32:55.329ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
29942024-11-01T08:32:55.329ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29952024-11-01T08:32:55.338ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b303d269-4d25-4e8c-887a-ce7d4874110f", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} })
29962024-11-01T08:32:55.340ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 643.059964ms iteration = 29 status = {}
29972024-11-01T08:32:55.340ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eef65a46-df2d-49db-b9e0-5331b5133d34", "content-length": "691", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} })
29982024-11-01T08:32:55.340ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29992024-11-01T08:32:55.340ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
30002024-11-01T08:32:55.340ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
30012024-11-01T08:32:55.341ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 645.468354ms iteration = 28 status = {}
30022024-11-01T08:32:55.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "85e4fe78-6993-44a2-b46f-3852dd00c662", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} })
30032024-11-01T08:32:55.452ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch = Switch0
30042024-11-01T08:32:55.452ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30052024-11-01T08:32:55.453ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d12c9f1-27ff-4460-b618-a8a567a13d20", "content-length": "669", "date": "Fri, 01 Nov 2024 08:32:55 GMT"} })
30062024-11-01T08:32:55.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30072024-11-01T08:32:55.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30082024-11-01T08:32:55.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30092024-11-01T08:32:55.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30102024-11-01T08:32:55.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30112024-11-01T08:32:55.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30122024-11-01T08:32:55.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30132024-11-01T08:32:55.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30142024-11-01T08:32:55.470ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 773.703424ms iteration = 27 status = {}
30152024-11-01T08:32:55.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c1f999b8-e046-47a5-8334-2d2c2b1c6e3c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30162024-11-01T08:32:55.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c1f999b8-e046-47a5-8334-2d2c2b1c6e3c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30172024-11-01T08:32:55.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c1f999b8-e046-47a5-8334-2d2c2b1c6e3c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30182024-11-01T08:32:56.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 17f2a932-f818-4a70-9ada-1e27dc0903c7 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30192024-11-01T08:32:56.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 17f2a932-f818-4a70-9ada-1e27dc0903c7 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30202024-11-01T08:32:56.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 17f2a932-f818-4a70-9ada-1e27dc0903c7 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30212024-11-01T08:32:57.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f3e25f00-bb37-4246-83ee-3d9eb0297d48 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30222024-11-01T08:32:57.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f3e25f00-bb37-4246-83ee-3d9eb0297d48 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30232024-11-01T08:32:57.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f3e25f00-bb37-4246-83ee-3d9eb0297d48 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30242024-11-01T08:32:58.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a30189b3-53fd-4ea8-b64c-25f8ac7e9c94 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30252024-11-01T08:32:58.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a30189b3-53fd-4ea8-b64c-25f8ac7e9c94 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30262024-11-01T08:32:58.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a30189b3-53fd-4ea8-b64c-25f8ac7e9c94 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30272024-11-01T08:32:59.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8c651b0e-2d16-4daa-809d-8151224e8adf roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30282024-11-01T08:32:59.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8c651b0e-2d16-4daa-809d-8151224e8adf resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30292024-11-01T08:32:59.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8c651b0e-2d16-4daa-809d-8151224e8adf response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30302024-11-01T08:33:00.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fe877a62-50f9-44ad-8818-b629aa8de9a3 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30312024-11-01T08:33:00.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fe877a62-50f9-44ad-8818-b629aa8de9a3 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30322024-11-01T08:33:00.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fe877a62-50f9-44ad-8818-b629aa8de9a3 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30332024-11-01T08:33:01.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = ba7a5fe2-12c5-446e-aa38-31cff484015f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
30342024-11-01T08:33:01.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = ba7a5fe2-12c5-446e-aa38-31cff484015f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
30352024-11-01T08:33:01.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = ba7a5fe2-12c5-446e-aa38-31cff484015f response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
30362024-11-01T08:33:01.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bcc9c830-edcf-4f25-9ff3-6cc24a50b502 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30372024-11-01T08:33:01.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bcc9c830-edcf-4f25-9ff3-6cc24a50b502 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30382024-11-01T08:33:01.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bcc9c830-edcf-4f25-9ff3-6cc24a50b502 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30392024-11-01T08:33:02.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 78514dbd-c64e-477e-a88b-a261030e7666 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30402024-11-01T08:33:02.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 78514dbd-c64e-477e-a88b-a261030e7666 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30412024-11-01T08:33:02.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 78514dbd-c64e-477e-a88b-a261030e7666 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30422024-11-01T08:33:03.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3da186b7-078f-4a8a-af6d-a16553219e62 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30432024-11-01T08:33:03.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3da186b7-078f-4a8a-af6d-a16553219e62 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30442024-11-01T08:33:03.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3da186b7-078f-4a8a-af6d-a16553219e62 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30452024-11-01T08:33:04.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
30462024-11-01T08:33:04.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30472024-11-01T08:33:04.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30482024-11-01T08:33:04.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
30492024-11-01T08:33:04.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30502024-11-01T08:33:04.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30512024-11-01T08:33:04.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30522024-11-01T08:33:04.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30532024-11-01T08:33:04.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30542024-11-01T08:33:04.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30552024-11-01T08:33:04.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30562024-11-01T08:33:04.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30572024-11-01T08:33:04.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30582024-11-01T08:33:04.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30592024-11-01T08:33:04.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30602024-11-01T08:33:04.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
30612024-11-01T08:33:04.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30622024-11-01T08:33:04.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30632024-11-01T08:33:04.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
30642024-11-01T08:33:04.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.315558ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
30652024-11-01T08:33:04.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.441937ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30662024-11-01T08:33:04.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dac15fe2-3ad7-4a9e-af78-0df6499d0eaa roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30672024-11-01T08:33:04.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dac15fe2-3ad7-4a9e-af78-0df6499d0eaa resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30682024-11-01T08:33:04.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dac15fe2-3ad7-4a9e-af78-0df6499d0eaa response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30692024-11-01T08:33:05.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1502 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 3b65a794-0df3-44d8-bc04-eeced575f683 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
30702024-11-01T08:33:05.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 60929ea1-cdc8-43e6-aab5-557bdc70f806 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30712024-11-01T08:33:05.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 60929ea1-cdc8-43e6-aab5-557bdc70f806 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30722024-11-01T08:33:05.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 60929ea1-cdc8-43e6-aab5-557bdc70f806 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30732024-11-01T08:33:06.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ec84e99b-4a22-4601-8bab-242503536b62 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30742024-11-01T08:33:06.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ec84e99b-4a22-4601-8bab-242503536b62 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30752024-11-01T08:33:06.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ec84e99b-4a22-4601-8bab-242503536b62 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30762024-11-01T08:33:07.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b9706008-f778-4409-8137-6059527043a3 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30772024-11-01T08:33:07.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b9706008-f778-4409-8137-6059527043a3 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30782024-11-01T08:33:07.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b9706008-f778-4409-8137-6059527043a3 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30792024-11-01T08:33:08.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7dc9ffd3-dca0-4c11-add7-17eaa21fe81c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30802024-11-01T08:33:08.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7dc9ffd3-dca0-4c11-add7-17eaa21fe81c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30812024-11-01T08:33:08.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7dc9ffd3-dca0-4c11-add7-17eaa21fe81c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30822024-11-01T08:33:09.692ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
30832024-11-01T08:33:09.692ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
30842024-11-01T08:33:09.723ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
30852024-11-01T08:33:09.723ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:59239
30862024-11-01T08:33:09.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59239 req_id = ddf8b415-8544-4e6f-b4c4-89749c2c68a4 roles = RoleSet { roles: {} } uri = /metrics/producers
30872024-11-01T08:33:09.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59239 req_id = ddf8b415-8544-4e6f-b4c4-89749c2c68a4 resource = Database result = Ok(()) uri = /metrics/producers
30882024-11-01T08:33:09.760ZINFOnexus: assigned collector to new producer collector_id = 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = nexus/src/app/oximeter.rs:76 producer_id = 6faaa15b-0dc5-4caa-9f63-b47fef16cf54
30892024-11-01T08:33:09.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37207 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59239 req_id = ddf8b415-8544-4e6f-b4c4-89749c2c68a4 response_code = 201 uri = /metrics/producers
30902024-11-01T08:33:09.760ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ddf8b415-8544-4e6f-b4c4-89749c2c68a4", "content-length": "41", "date": "Fri, 01 Nov 2024 08:33:08 GMT"} })
30912024-11-01T08:33:09.762ZDEBGnexus (producer-registration-task): registered with nexus successfully
30922024-11-01T08:33:09.762ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
30932024-11-01T08:33:09.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a69c5831-15bd-431a-8afb-75287fa12d8d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30942024-11-01T08:33:09.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a69c5831-15bd-431a-8afb-75287fa12d8d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30952024-11-01T08:33:09.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a69c5831-15bd-431a-8afb-75287fa12d8d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30962024-11-01T08:33:10.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2252b015-e913-4e12-8d9c-2c78f6cab092 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30972024-11-01T08:33:10.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2252b015-e913-4e12-8d9c-2c78f6cab092 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30982024-11-01T08:33:10.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2252b015-e913-4e12-8d9c-2c78f6cab092 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
30992024-11-01T08:33:12.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dc59d636-63dd-4a13-84f0-17ba135a3da1 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31002024-11-01T08:33:12.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dc59d636-63dd-4a13-84f0-17ba135a3da1 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31012024-11-01T08:33:12.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dc59d636-63dd-4a13-84f0-17ba135a3da1 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31022024-11-01T08:33:13.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e2fe1b7e-e977-4ad6-91c5-49ea338fee02 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31032024-11-01T08:33:13.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e2fe1b7e-e977-4ad6-91c5-49ea338fee02 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31042024-11-01T08:33:13.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e2fe1b7e-e977-4ad6-91c5-49ea338fee02 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31052024-11-01T08:33:14.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b88b1b53-e289-42ab-9b4b-705622b4f613 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31062024-11-01T08:33:14.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b88b1b53-e289-42ab-9b4b-705622b4f613 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31072024-11-01T08:33:14.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b88b1b53-e289-42ab-9b4b-705622b4f613 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31082024-11-01T08:33:14.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
31092024-11-01T08:33:14.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31102024-11-01T08:33:14.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31112024-11-01T08:33:14.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
31122024-11-01T08:33:14.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31132024-11-01T08:33:14.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31142024-11-01T08:33:14.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31152024-11-01T08:33:14.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31162024-11-01T08:33:14.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31172024-11-01T08:33:14.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31182024-11-01T08:33:14.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31192024-11-01T08:33:14.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31202024-11-01T08:33:14.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31212024-11-01T08:33:14.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
31222024-11-01T08:33:14.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31232024-11-01T08:33:14.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31242024-11-01T08:33:14.720ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
31252024-11-01T08:33:14.720ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.766924ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
31262024-11-01T08:33:14.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31272024-11-01T08:33:14.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31282024-11-01T08:33:14.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.13375ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31292024-11-01T08:33:15.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ca2da040-2e6d-4844-81f6-d4f07d12596f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31302024-11-01T08:33:15.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ca2da040-2e6d-4844-81f6-d4f07d12596f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31312024-11-01T08:33:15.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ca2da040-2e6d-4844-81f6-d4f07d12596f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31322024-11-01T08:33:16.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9b010eb5-02d8-43e1-abb2-e90e0f8274b5 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31332024-11-01T08:33:16.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9b010eb5-02d8-43e1-abb2-e90e0f8274b5 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31342024-11-01T08:33:16.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9b010eb5-02d8-43e1-abb2-e90e0f8274b5 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31352024-11-01T08:33:17.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3a1c10eb-c9c8-49e8-af7d-3f901d28ff20 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31362024-11-01T08:33:17.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3a1c10eb-c9c8-49e8-af7d-3f901d28ff20 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31372024-11-01T08:33:17.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3a1c10eb-c9c8-49e8-af7d-3f901d28ff20 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31382024-11-01T08:33:18.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 49f6da5c-ddac-4397-aa8a-3594cda346df roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31392024-11-01T08:33:18.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 49f6da5c-ddac-4397-aa8a-3594cda346df resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31402024-11-01T08:33:18.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 49f6da5c-ddac-4397-aa8a-3594cda346df response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31412024-11-01T08:33:19.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7fa40a9b-f35e-4e44-ba36-d04d2d9f31ed roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31422024-11-01T08:33:19.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7fa40a9b-f35e-4e44-ba36-d04d2d9f31ed resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31432024-11-01T08:33:19.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7fa40a9b-f35e-4e44-ba36-d04d2d9f31ed response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31442024-11-01T08:33:20.202ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 4cc43473-c3b9-48c3-8b23-7676217f2182 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
31452024-11-01T08:33:20.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d8bfea00-ae88-42db-bbed-0334fcd096d5 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31462024-11-01T08:33:20.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d8bfea00-ae88-42db-bbed-0334fcd096d5 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31472024-11-01T08:33:20.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = d8bfea00-ae88-42db-bbed-0334fcd096d5 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31482024-11-01T08:33:21.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ea9afad-1b47-4ad5-8c15-e53524dd18bc roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31492024-11-01T08:33:21.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ea9afad-1b47-4ad5-8c15-e53524dd18bc resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31502024-11-01T08:33:21.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ea9afad-1b47-4ad5-8c15-e53524dd18bc response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31512024-11-01T08:33:22.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1f65407a-22c0-4b33-9134-515e544c4b99 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31522024-11-01T08:33:22.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1f65407a-22c0-4b33-9134-515e544c4b99 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31532024-11-01T08:33:22.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1f65407a-22c0-4b33-9134-515e544c4b99 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31542024-11-01T08:33:23.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3e22b979-1b29-47fa-9cff-6bf7fccdecd9 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31552024-11-01T08:33:23.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3e22b979-1b29-47fa-9cff-6bf7fccdecd9 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31562024-11-01T08:33:23.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3e22b979-1b29-47fa-9cff-6bf7fccdecd9 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31572024-11-01T08:33:24.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 83a670bb-dce2-4195-be6a-f724c26fd993 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31582024-11-01T08:33:24.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 83a670bb-dce2-4195-be6a-f724c26fd993 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31592024-11-01T08:33:24.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 83a670bb-dce2-4195-be6a-f724c26fd993 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
31602024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
31612024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
31622024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31632024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31642024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
31652024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
31662024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31672024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
31682024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
31692024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31702024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31712024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
31722024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31732024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
31742024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
31752024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 19.31\u{b5}s iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31762024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.86\u{b5}s iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31772024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
31782024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
31792024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
31802024-11-01T08:33:24.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.31\u{b5}s iteration = 28 status = {"errors":[],"records_set_to_done":[]}
31812024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
31822024-11-01T08:33:24.697ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31832024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.92\u{b5}s iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
31842024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
31852024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31862024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
31872024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31882024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31892024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31902024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31912024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
31922024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31932024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
31942024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31952024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31962024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31972024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31982024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31992024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32002024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32012024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32022024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32032024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32042024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32052024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32062024-11-01T08:33:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32072024-11-01T08:33:24.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082024-11-01T08:33:24.700ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32092024-11-01T08:33:24.700ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32102024-11-01T08:33:24.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32112024-11-01T08:33:24.700ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.205703ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32122024-11-01T08:33:24.701ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4969, tv_nsec: 546413054 } })
32132024-11-01T08:33:24.702ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
32142024-11-01T08:33:24.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32152024-11-01T08:33:24.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32162024-11-01T08:33:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32172024-11-01T08:33:24.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32182024-11-01T08:33:24.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32192024-11-01T08:33:24.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32202024-11-01T08:33:24.707ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4969, tv_nsec: 551570251 } })
32212024-11-01T08:33:24.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32222024-11-01T08:33:24.707ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
32232024-11-01T08:33:24.710ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32242024-11-01T08:33:24.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32252024-11-01T08:33:24.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32262024-11-01T08:33:24.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32272024-11-01T08:33:24.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32282024-11-01T08:33:24.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32292024-11-01T08:33:24.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32302024-11-01T08:33:24.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32312024-11-01T08:33:24.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32322024-11-01T08:33:24.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32332024-11-01T08:33:24.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32342024-11-01T08:33:24.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32352024-11-01T08:33:24.717ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32362024-11-01T08:33:24.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32372024-11-01T08:33:24.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32382024-11-01T08:33:24.719ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32392024-11-01T08:33:24.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32402024-11-01T08:33:24.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32412024-11-01T08:33:24.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32422024-11-01T08:33:24.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32432024-11-01T08:33:24.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32442024-11-01T08:33:24.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32452024-11-01T08:33:24.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32462024-11-01T08:33:24.733ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32472024-11-01T08:33:24.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f7fe3bf0-db6a-428d-8129-f334aa61483d, lookup_type: ById(f7fe3bf0-db6a-428d-8129-f334aa61483d) } result = Ok(())
32482024-11-01T08:33:24.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32492024-11-01T08:33:24.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32502024-11-01T08:33:24.740ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 43.269853ms iteration = 28 status = 0
32512024-11-01T08:33:24.744ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32522024-11-01T08:33:24.744ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32532024-11-01T08:33:24.744ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32542024-11-01T08:33:24.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32552024-11-01T08:33:24.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32562024-11-01T08:33:24.746ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32572024-11-01T08:33:24.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32582024-11-01T08:33:24.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32592024-11-01T08:33:24.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32602024-11-01T08:33:24.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32612024-11-01T08:33:24.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32622024-11-01T08:33:24.752ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4969, tv_nsec: 596692140 } })
32632024-11-01T08:33:24.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32642024-11-01T08:33:24.752ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
32652024-11-01T08:33:24.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32662024-11-01T08:33:24.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32672024-11-01T08:33:24.753ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32682024-11-01T08:33:24.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32692024-11-01T08:33:24.755ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32702024-11-01T08:33:24.755ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32712024-11-01T08:33:24.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32722024-11-01T08:33:24.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
32732024-11-01T08:33:24.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32742024-11-01T08:33:24.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32752024-11-01T08:33:24.758ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.777468ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32762024-11-01T08:33:24.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
32772024-11-01T08:33:24.761ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32782024-11-01T08:33:24.761ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56c61345-afd4-4cae-80ca-9811c19a0a5c", "content-length": "26", "date": "Fri, 01 Nov 2024 08:33:24 GMT"} })
32792024-11-01T08:33:24.761ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32802024-11-01T08:33:24.762ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
32812024-11-01T08:33:24.762ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32822024-11-01T08:33:24.762ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40e2c4ce-a71e-4e93-85fd-733d4301267d", "content-length": "26", "date": "Fri, 01 Nov 2024 08:33:24 GMT"} })
32832024-11-01T08:33:24.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32842024-11-01T08:33:24.763ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32852024-11-01T08:33:24.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32862024-11-01T08:33:24.768ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
32872024-11-01T08:33:24.768ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.209784ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
32882024-11-01T08:33:24.782ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.85163ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32892024-11-01T08:33:24.786ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32902024-11-01T08:33:24.786ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32912024-11-01T08:33:24.786ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32922024-11-01T08:33:24.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32932024-11-01T08:33:24.803ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32942024-11-01T08:33:24.803ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.827175ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32952024-11-01T08:33:24.820ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32962024-11-01T08:33:24.820ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32972024-11-01T08:33:24.820ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.847584ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32982024-11-01T08:33:24.822ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 125.859174ms iteration = 32 status = {"physical_disks_added":0}
32992024-11-01T08:33:24.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33002024-11-01T08:33:24.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33012024-11-01T08:33:24.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33022024-11-01T08:33:24.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33032024-11-01T08:33:24.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33042024-11-01T08:33:24.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33052024-11-01T08:33:24.868ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33062024-11-01T08:33:24.868ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e43917ab-b456-49a4-a106-8f06e917dfa1", "content-length": "2", "date": "Fri, 01 Nov 2024 08:33:24 GMT"} })
33072024-11-01T08:33:24.869ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33082024-11-01T08:33:24.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33092024-11-01T08:33:25.033ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 zone_address = fd00:1122:3344:101::2
33102024-11-01T08:33:25.033ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33112024-11-01T08:33:25.034ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "48faafdd-8ef8-4cc1-904a-9c290f81c80e", "content-length": "26", "date": "Fri, 01 Nov 2024 08:33:24 GMT"} })
33122024-11-01T08:33:25.034ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33132024-11-01T08:33:25.036ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
33142024-11-01T08:33:25.039ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 342.827025ms iteration = 28 status = {}
33152024-11-01T08:33:25.050ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33162024-11-01T08:33:25.050ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33172024-11-01T08:33:25.052ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 356.125022ms iteration = 28 status = null
33182024-11-01T08:33:25.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33192024-11-01T08:33:25.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33202024-11-01T08:33:25.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33212024-11-01T08:33:25.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33222024-11-01T08:33:25.083ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "119df7b0-b058-4bc1-804f-3d3b8d246acf", "content-length": "372", "date": "Fri, 01 Nov 2024 08:33:24 GMT"} })
33232024-11-01T08:33:25.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33242024-11-01T08:33:25.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33252024-11-01T08:33:25.131ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
33262024-11-01T08:33:25.131ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33272024-11-01T08:33:25.131ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c37d0afa-3401-4117-96d5-f72b0e2e8ddf", "date": "Fri, 01 Nov 2024 08:33:25 GMT"} })
33282024-11-01T08:33:25.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33292024-11-01T08:33:25.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33302024-11-01T08:33:25.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33312024-11-01T08:33:25.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33322024-11-01T08:33:25.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33332024-11-01T08:33:25.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33342024-11-01T08:33:25.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33352024-11-01T08:33:25.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33362024-11-01T08:33:25.138ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e2aedfd9-3b4d-40ab-920a-0ddf803678fe, rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a0c3e848-f136-4ae5-b986-95beae550c75) } rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
33372024-11-01T08:33:25.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33382024-11-01T08:33:25.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33392024-11-01T08:33:25.143ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33402024-11-01T08:33:25.143ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33412024-11-01T08:33:25.143ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d153f7ef-2014-4ff7-98b0-f6e01b972727", "date": "Fri, 01 Nov 2024 08:33:25 GMT"} })
33422024-11-01T08:33:25.145ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 448.517443ms iteration = 30 status = {}
33432024-11-01T08:33:25.148ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33442024-11-01T08:33:25.148ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed43cb63-ded3-43cd-8f50-e6f62e3c394c", "content-length": "121", "date": "Fri, 01 Nov 2024 08:33:24 GMT"} })
33452024-11-01T08:33:25.148ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
33462024-11-01T08:33:25.148ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a0c3e848-f136-4ae5-b986-95beae550c75
33472024-11-01T08:33:25.148ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33482024-11-01T08:33:25.148ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33492024-11-01T08:33:25.148ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33502024-11-01T08:33:25.148ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33512024-11-01T08:33:25.148ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33522024-11-01T08:33:25.148ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33532024-11-01T08:33:25.148ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33542024-11-01T08:33:25.148ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33552024-11-01T08:33:25.149ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
33562024-11-01T08:33:25.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33572024-11-01T08:33:25.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33582024-11-01T08:33:25.151ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33592024-11-01T08:33:25.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca9288c4-bdd7-4d38-9632-7e07f144fd20", "content-length": "2", "date": "Fri, 01 Nov 2024 08:33:24 GMT"} })
33602024-11-01T08:33:25.151ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33612024-11-01T08:33:25.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0c718c7-1b4d-489a-a72e-c802c8aef132", "content-length": "52", "date": "Fri, 01 Nov 2024 08:33:24 GMT"} })
33622024-11-01T08:33:25.151ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
33632024-11-01T08:33:25.151ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33642024-11-01T08:33:25.177ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33652024-11-01T08:33:25.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = b7a57440-d1b6-4625-81f8-d1e027c81ddb roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
33662024-11-01T08:33:25.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = b7a57440-d1b6-4625-81f8-d1e027c81ddb resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
33672024-11-01T08:33:25.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = b7a57440-d1b6-4625-81f8-d1e027c81ddb response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?sort_by=id_ascending
33682024-11-01T08:33:25.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 07d8493a-4d28-4a3b-bd7b-fe6038388d43 roles = RoleSet { roles: {} } uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
33692024-11-01T08:33:25.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 07d8493a-4d28-4a3b-bd7b-fe6038388d43 resource = Database result = Ok(()) uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
33702024-11-01T08:33:25.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60842 req_id = 07d8493a-4d28-4a3b-bd7b-fe6038388d43 response_code = 200 uri = /metrics/collectors/05b98a5a-6633-46a8-a87e-d44dea0d2ec7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYjIwNDU1OS01NTQ0LTQ4YTItYWE2OS0yMjBkMmFiOTI4OTkifX0%3D
33712024-11-01T08:33:25.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "19aa0ef0-50ef-41ee-a331-b162317d051a", "date": "Fri, 01 Nov 2024 08:33:25 GMT"} })
33722024-11-01T08:33:25.258ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch = Switch0
33732024-11-01T08:33:25.258ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33742024-11-01T08:33:25.258ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a2bce81-c40f-428c-a059-ca591dd1dce0", "content-length": "691", "date": "Fri, 01 Nov 2024 08:33:25 GMT"} })
33752024-11-01T08:33:25.259ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
33762024-11-01T08:33:25.259ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
33772024-11-01T08:33:25.259ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
33782024-11-01T08:33:25.259ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b468be3-3552-4b5b-b455-70c48dafc490", "content-length": "669", "date": "Fri, 01 Nov 2024 08:33:24 GMT"} })
33792024-11-01T08:33:25.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33802024-11-01T08:33:25.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33812024-11-01T08:33:25.261ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 564.561935ms iteration = 29 status = {}
33822024-11-01T08:33:25.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33832024-11-01T08:33:25.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33842024-11-01T08:33:25.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33852024-11-01T08:33:25.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33862024-11-01T08:33:25.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33872024-11-01T08:33:25.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33882024-11-01T08:33:25.276ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 579.293377ms iteration = 28 status = {}
33892024-11-01T08:33:25.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 612932c0-81f1-447b-a76b-dfe13c189612 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
33902024-11-01T08:33:25.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 612932c0-81f1-447b-a76b-dfe13c189612 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
33912024-11-01T08:33:25.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 612932c0-81f1-447b-a76b-dfe13c189612 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
33922024-11-01T08:33:26.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 13390799-9c4a-4b68-aed2-9d8eac95252a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
33932024-11-01T08:33:26.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 13390799-9c4a-4b68-aed2-9d8eac95252a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
33942024-11-01T08:33:26.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 13390799-9c4a-4b68-aed2-9d8eac95252a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
33952024-11-01T08:33:27.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0105aef6-b1f1-419a-b64d-26a800209e21 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
33962024-11-01T08:33:27.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0105aef6-b1f1-419a-b64d-26a800209e21 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
33972024-11-01T08:33:27.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0105aef6-b1f1-419a-b64d-26a800209e21 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
33982024-11-01T08:33:28.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6e98380b-9d3a-4556-a447-2a18be8b1404 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
33992024-11-01T08:33:28.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6e98380b-9d3a-4556-a447-2a18be8b1404 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34002024-11-01T08:33:28.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6e98380b-9d3a-4556-a447-2a18be8b1404 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34012024-11-01T08:33:29.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ba7a4d4f-c15d-4325-9b04-2b0b4a8ea3af roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34022024-11-01T08:33:29.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ba7a4d4f-c15d-4325-9b04-2b0b4a8ea3af resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34032024-11-01T08:33:29.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = ba7a4d4f-c15d-4325-9b04-2b0b4a8ea3af response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34042024-11-01T08:33:30.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 862226c0-024f-4fe3-a437-d6cf69bb362d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34052024-11-01T08:33:30.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 862226c0-024f-4fe3-a437-d6cf69bb362d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34062024-11-01T08:33:30.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 862226c0-024f-4fe3-a437-d6cf69bb362d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34072024-11-01T08:33:31.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bf954eb4-99f2-42e1-8fb2-713d7995467f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34082024-11-01T08:33:31.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bf954eb4-99f2-42e1-8fb2-713d7995467f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34092024-11-01T08:33:31.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = bf954eb4-99f2-42e1-8fb2-713d7995467f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34102024-11-01T08:33:31.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 7140d030-02e5-4d96-b1d2-478102382e9d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
34112024-11-01T08:33:31.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 7140d030-02e5-4d96-b1d2-478102382e9d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
34122024-11-01T08:33:31.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 7140d030-02e5-4d96-b1d2-478102382e9d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
34132024-11-01T08:33:32.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 23c95e71-c858-49a5-965c-a4f057a3f0b2 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34142024-11-01T08:33:32.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 23c95e71-c858-49a5-965c-a4f057a3f0b2 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34152024-11-01T08:33:32.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 23c95e71-c858-49a5-965c-a4f057a3f0b2 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34162024-11-01T08:33:33.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 85c51bec-1fcf-4801-89e8-fa19501991dc roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34172024-11-01T08:33:33.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 85c51bec-1fcf-4801-89e8-fa19501991dc resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34182024-11-01T08:33:33.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 85c51bec-1fcf-4801-89e8-fa19501991dc response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34192024-11-01T08:33:34.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = db62d7c7-db3b-4aea-bc85-052ee88b0fdc roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34202024-11-01T08:33:34.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = db62d7c7-db3b-4aea-bc85-052ee88b0fdc resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34212024-11-01T08:33:34.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = db62d7c7-db3b-4aea-bc85-052ee88b0fdc response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34222024-11-01T08:33:34.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
34232024-11-01T08:33:34.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34242024-11-01T08:33:34.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34252024-11-01T08:33:34.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
34262024-11-01T08:33:34.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34272024-11-01T08:33:34.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34282024-11-01T08:33:34.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34292024-11-01T08:33:34.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34302024-11-01T08:33:34.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34312024-11-01T08:33:34.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34322024-11-01T08:33:34.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34332024-11-01T08:33:34.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34342024-11-01T08:33:34.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34352024-11-01T08:33:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
34362024-11-01T08:33:34.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34372024-11-01T08:33:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34382024-11-01T08:33:34.718ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
34392024-11-01T08:33:34.719ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.77302ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
34402024-11-01T08:33:34.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34412024-11-01T08:33:34.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34422024-11-01T08:33:34.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.150775ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34432024-11-01T08:33:35.202ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 8e066a1a-d747-4e60-ba01-80c1943d1f51 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
34442024-11-01T08:33:35.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2ca86aa4-aadd-4aa4-baf7-dde06dfda84e roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34452024-11-01T08:33:35.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2ca86aa4-aadd-4aa4-baf7-dde06dfda84e resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34462024-11-01T08:33:35.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2ca86aa4-aadd-4aa4-baf7-dde06dfda84e response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34472024-11-01T08:33:36.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dd5d98d8-659b-49cb-82fb-7237a473f72a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34482024-11-01T08:33:36.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dd5d98d8-659b-49cb-82fb-7237a473f72a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34492024-11-01T08:33:36.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = dd5d98d8-659b-49cb-82fb-7237a473f72a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34502024-11-01T08:33:37.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6fe70ab8-643f-4a1d-89a1-3e7ec2cf0d26 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34512024-11-01T08:33:37.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6fe70ab8-643f-4a1d-89a1-3e7ec2cf0d26 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34522024-11-01T08:33:37.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6fe70ab8-643f-4a1d-89a1-3e7ec2cf0d26 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34532024-11-01T08:33:38.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5429a639-10e5-4dcf-924a-459fc8980d76 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34542024-11-01T08:33:38.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5429a639-10e5-4dcf-924a-459fc8980d76 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34552024-11-01T08:33:38.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 5429a639-10e5-4dcf-924a-459fc8980d76 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34562024-11-01T08:33:39.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 764d9348-6910-47f8-9e63-603feba42259 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34572024-11-01T08:33:39.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 764d9348-6910-47f8-9e63-603feba42259 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34582024-11-01T08:33:39.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 764d9348-6910-47f8-9e63-603feba42259 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34592024-11-01T08:33:40.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3615cb06-a0bc-43a1-b65b-f66af8251cc9 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34602024-11-01T08:33:40.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3615cb06-a0bc-43a1-b65b-f66af8251cc9 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34612024-11-01T08:33:40.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3615cb06-a0bc-43a1-b65b-f66af8251cc9 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34622024-11-01T08:33:41.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ee0c970-1aed-474c-8e07-87bb188d8eda roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34632024-11-01T08:33:41.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ee0c970-1aed-474c-8e07-87bb188d8eda resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34642024-11-01T08:33:41.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3ee0c970-1aed-474c-8e07-87bb188d8eda response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34652024-11-01T08:33:42.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fd22adf4-b326-443e-8e3a-f7db4d19372a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34662024-11-01T08:33:42.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fd22adf4-b326-443e-8e3a-f7db4d19372a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34672024-11-01T08:33:42.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2717 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = fd22adf4-b326-443e-8e3a-f7db4d19372a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34682024-11-01T08:33:43.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0462902b-6d77-4cd6-9ab3-b99e3a6f9297 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34692024-11-01T08:33:43.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0462902b-6d77-4cd6-9ab3-b99e3a6f9297 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34702024-11-01T08:33:43.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 0462902b-6d77-4cd6-9ab3-b99e3a6f9297 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34712024-11-01T08:33:44.695ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
34722024-11-01T08:33:44.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34732024-11-01T08:33:44.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34742024-11-01T08:33:44.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
34752024-11-01T08:33:44.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34762024-11-01T08:33:44.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34772024-11-01T08:33:44.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34782024-11-01T08:33:44.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34792024-11-01T08:33:44.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34802024-11-01T08:33:44.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34812024-11-01T08:33:44.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34822024-11-01T08:33:44.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34832024-11-01T08:33:44.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.721666ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34842024-11-01T08:33:44.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34852024-11-01T08:33:44.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34862024-11-01T08:33:44.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34872024-11-01T08:33:44.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
34882024-11-01T08:33:44.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34892024-11-01T08:33:44.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34902024-11-01T08:33:44.717ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
34912024-11-01T08:33:44.717ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.918759ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
34922024-11-01T08:33:44.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6557b10f-2776-47d1-a2a8-0f22a380b4f4 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34932024-11-01T08:33:44.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6557b10f-2776-47d1-a2a8-0f22a380b4f4 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34942024-11-01T08:33:44.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6557b10f-2776-47d1-a2a8-0f22a380b4f4 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34952024-11-01T08:33:45.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1b91df24-97ac-48af-8f89-cb6ed933b281 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34962024-11-01T08:33:45.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1b91df24-97ac-48af-8f89-cb6ed933b281 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34972024-11-01T08:33:45.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 1b91df24-97ac-48af-8f89-cb6ed933b281 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34982024-11-01T08:33:46.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6a92720f-3c09-4230-b522-ac625a86e72a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
34992024-11-01T08:33:46.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6a92720f-3c09-4230-b522-ac625a86e72a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35002024-11-01T08:33:46.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 6a92720f-3c09-4230-b522-ac625a86e72a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35012024-11-01T08:33:47.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8971f782-4d8e-4500-8876-f1f6c68a1cbf roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35022024-11-01T08:33:47.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8971f782-4d8e-4500-8876-f1f6c68a1cbf resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35032024-11-01T08:33:47.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8971f782-4d8e-4500-8876-f1f6c68a1cbf response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35042024-11-01T08:33:48.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 37f7733c-2ebe-458f-8982-1d071f58612f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35052024-11-01T08:33:48.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 37f7733c-2ebe-458f-8982-1d071f58612f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35062024-11-01T08:33:48.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 37f7733c-2ebe-458f-8982-1d071f58612f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35072024-11-01T08:33:49.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9c776a7b-21e5-46d9-a65f-62bdf3b296ba roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35082024-11-01T08:33:49.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9c776a7b-21e5-46d9-a65f-62bdf3b296ba resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35092024-11-01T08:33:49.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9c776a7b-21e5-46d9-a65f-62bdf3b296ba response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35102024-11-01T08:33:50.201ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1543 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 70dfc94f-3359-45b3-9ca5-6164816e7cea response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
35112024-11-01T08:33:50.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9e4813b2-aa1c-4ce2-8cab-faae40524d30 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35122024-11-01T08:33:50.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9e4813b2-aa1c-4ce2-8cab-faae40524d30 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35132024-11-01T08:33:50.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 9e4813b2-aa1c-4ce2-8cab-faae40524d30 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35142024-11-01T08:33:51.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b5821e6a-620d-42b3-ac3f-1c5e6bfedd4d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35152024-11-01T08:33:51.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b5821e6a-620d-42b3-ac3f-1c5e6bfedd4d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35162024-11-01T08:33:51.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b5821e6a-620d-42b3-ac3f-1c5e6bfedd4d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35172024-11-01T08:33:52.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b6cdc87e-eb0b-445a-9032-b823ed844fb3 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35182024-11-01T08:33:52.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b6cdc87e-eb0b-445a-9032-b823ed844fb3 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35192024-11-01T08:33:52.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b6cdc87e-eb0b-445a-9032-b823ed844fb3 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35202024-11-01T08:33:54.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 892d289a-e2e3-48a6-80a9-451c2d77c357 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35212024-11-01T08:33:54.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 892d289a-e2e3-48a6-80a9-451c2d77c357 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35222024-11-01T08:33:54.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 892d289a-e2e3-48a6-80a9-451c2d77c357 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
35232024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
35242024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
35252024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35262024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
35272024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35282024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35292024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
35302024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
35312024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35322024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35332024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
35342024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
35352024-11-01T08:33:54.696ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 08:23:54.696196625 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
35362024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
35372024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
35382024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
35392024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35402024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
35412024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
35422024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35432024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
35442024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
35452024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35462024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
35472024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
35482024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35492024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
35502024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35512024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
35522024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
35532024-11-01T08:33:54.696ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
35542024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
35552024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
35562024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35572024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
35582024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
35592024-11-01T08:33:54.696ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876
35602024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.68\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876"}
35612024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35622024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35632024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
35642024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35652024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35662024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35672024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35682024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35692024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35702024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
35712024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
35722024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
35732024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35742024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.76\u{b5}s iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35752024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
35762024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
35772024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
35782024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35792024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35802024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35812024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
35822024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35832024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
35842024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
35852024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35862024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
35872024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
35882024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
35892024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.271\u{b5}s iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
35902024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.791\u{b5}s iteration = 29 status = {"errors":[],"records_set_to_done":[]}
35912024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.451\u{b5}s iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
35922024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
35932024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35942024-11-01T08:33:54.696ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35952024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35962024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35972024-11-01T08:33:54.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35982024-11-01T08:33:54.696ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4bab0cba-a00a-4740-88aa-0040e016028d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("726c5ac9-9d5f-4339-8159-0a04793fd959.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 4999, tv_nsec: 541656784 } })
35992024-11-01T08:33:54.697ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7a6aafb-271b-4c58-a4ee-a120d4fe517b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5a9d05d-8509-4c10-96d8-97ac84fede0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5a9d05d-8509-4c10-96d8-97ac84fede0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 4999, tv_nsec: 541679684 } })
36002024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
36012024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
36022024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
36032024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36042024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36052024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36062024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36072024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
36082024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
36092024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.171849ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
36102024-11-01T08:33:54.697ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.079777ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
36112024-11-01T08:33:54.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36122024-11-01T08:33:54.699ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4999, tv_nsec: 544447752 } })
36132024-11-01T08:33:54.699ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
36142024-11-01T08:33:54.700ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.908936ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36152024-11-01T08:33:54.700ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 08:23:54.696196625 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
36162024-11-01T08:33:54.700ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.245424ms iteration = 15 status = {"expiration":"2024-11-01T08:23:54.696196625Z","pruned":[]}
36172024-11-01T08:33:54.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36182024-11-01T08:33:54.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36192024-11-01T08:33:54.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36202024-11-01T08:33:54.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36212024-11-01T08:33:54.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36222024-11-01T08:33:54.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36232024-11-01T08:33:54.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36242024-11-01T08:33:54.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36252024-11-01T08:33:54.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36262024-11-01T08:33:54.706ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4999, tv_nsec: 551157317 } })
36272024-11-01T08:33:54.706ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
36282024-11-01T08:33:54.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36292024-11-01T08:33:54.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36302024-11-01T08:33:54.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36312024-11-01T08:33:54.707ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36322024-11-01T08:33:54.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36332024-11-01T08:33:54.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36342024-11-01T08:33:54.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36352024-11-01T08:33:54.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36362024-11-01T08:33:54.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36372024-11-01T08:33:54.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36382024-11-01T08:33:54.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36392024-11-01T08:33:54.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36402024-11-01T08:33:54.712ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36412024-11-01T08:33:54.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36422024-11-01T08:33:54.712ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.204578ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
36432024-11-01T08:33:54.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36442024-11-01T08:33:54.715ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36452024-11-01T08:33:54.715ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36462024-11-01T08:33:54.715ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36472024-11-01T08:33:54.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36482024-11-01T08:33:54.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36492024-11-01T08:33:54.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36502024-11-01T08:33:54.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36512024-11-01T08:33:54.718ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4999, tv_nsec: 563176142 } })
36522024-11-01T08:33:54.718ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36532024-11-01T08:33:54.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36542024-11-01T08:33:54.718ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
36552024-11-01T08:33:54.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36562024-11-01T08:33:54.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36572024-11-01T08:33:54.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36582024-11-01T08:33:54.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36592024-11-01T08:33:54.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36602024-11-01T08:33:54.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36612024-11-01T08:33:54.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36622024-11-01T08:33:54.725ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36632024-11-01T08:33:54.725ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36642024-11-01T08:33:54.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36652024-11-01T08:33:54.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36662024-11-01T08:33:54.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
36672024-11-01T08:33:54.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36682024-11-01T08:33:54.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36692024-11-01T08:33:54.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36702024-11-01T08:33:54.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36712024-11-01T08:33:54.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36722024-11-01T08:33:54.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36732024-11-01T08:33:54.755ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36742024-11-01T08:33:54.758ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36752024-11-01T08:33:54.758ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36762024-11-01T08:33:54.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36772024-11-01T08:33:54.760ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36782024-11-01T08:33:54.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36792024-11-01T08:33:54.763ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36802024-11-01T08:33:54.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
36812024-11-01T08:33:54.768ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36822024-11-01T08:33:54.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36832024-11-01T08:33:54.769ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36842024-11-01T08:33:54.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36852024-11-01T08:33:54.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36862024-11-01T08:33:54.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36872024-11-01T08:33:54.772ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
36882024-11-01T08:33:54.772ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.881349ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
36892024-11-01T08:33:54.773ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 77.331791ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36902024-11-01T08:33:54.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
36912024-11-01T08:33:54.774ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
36922024-11-01T08:33:54.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
36932024-11-01T08:33:54.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36942024-11-01T08:33:54.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36952024-11-01T08:33:54.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36962024-11-01T08:33:54.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36972024-11-01T08:33:54.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36982024-11-01T08:33:54.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36992024-11-01T08:33:54.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37002024-11-01T08:33:54.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37012024-11-01T08:33:54.777ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37022024-11-01T08:33:54.778ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
37032024-11-01T08:33:54.778ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
37042024-11-01T08:33:54.778ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 82.024715ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
37052024-11-01T08:33:54.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37062024-11-01T08:33:54.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f7fe3bf0-db6a-428d-8129-f334aa61483d, lookup_type: ById(f7fe3bf0-db6a-428d-8129-f334aa61483d) } result = Ok(())
37072024-11-01T08:33:54.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37082024-11-01T08:33:54.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37092024-11-01T08:33:54.782ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
37102024-11-01T08:33:54.782ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
37112024-11-01T08:33:54.782ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
37122024-11-01T08:33:54.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37132024-11-01T08:33:54.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37142024-11-01T08:33:54.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.281451ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37152024-11-01T08:33:54.783ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.624674ms iteration = 29 status = 0
37162024-11-01T08:33:54.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172024-11-01T08:33:54.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37182024-11-01T08:33:54.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37192024-11-01T08:33:54.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37202024-11-01T08:33:54.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37212024-11-01T08:33:54.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37222024-11-01T08:33:54.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37232024-11-01T08:33:54.791ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
37242024-11-01T08:33:54.791ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b06c736-f13d-44f4-95f3-1c25c945a356 dns_zone_name = oxide.test found_so_far = 0 version = 2
37252024-11-01T08:33:54.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37262024-11-01T08:33:54.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37272024-11-01T08:33:54.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37282024-11-01T08:33:54.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37292024-11-01T08:33:54.795ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37302024-11-01T08:33:54.795ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37312024-11-01T08:33:54.795ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.734626ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37322024-11-01T08:33:54.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37332024-11-01T08:33:54.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37342024-11-01T08:33:54.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37352024-11-01T08:33:54.800ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b06c736-f13d-44f4-95f3-1c25c945a356 dns_zone_name = oxide.test found_so_far = 1 version = 2
37362024-11-01T08:33:54.800ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
37372024-11-01T08:33:54.800ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 08:20:37.945638 UTC dns_group = external generation = 2
37382024-11-01T08:33:54.800ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 104.448937ms iteration = 16 status = {"generation":2}
37392024-11-01T08:33:54.813ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37402024-11-01T08:33:54.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
37412024-11-01T08:33:54.815ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
37422024-11-01T08:33:54.815ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
37432024-11-01T08:33:54.815ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
37442024-11-01T08:33:54.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37452024-11-01T08:33:54.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37462024-11-01T08:33:54.821ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
37472024-11-01T08:33:54.821ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
37482024-11-01T08:33:54.821ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.826368ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
37492024-11-01T08:33:54.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37502024-11-01T08:33:54.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37512024-11-01T08:33:54.834ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37522024-11-01T08:33:54.834ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 137.391706ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37532024-11-01T08:33:54.850ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
37542024-11-01T08:33:54.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37552024-11-01T08:33:54.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37562024-11-01T08:33:54.883ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
37572024-11-01T08:33:54.883ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37582024-11-01T08:33:54.884ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83eba890-ba4a-4a86-8b93-fa73bbc76bd0", "content-length": "26", "date": "Fri, 01 Nov 2024 08:33:54 GMT"} })
37592024-11-01T08:33:54.884ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37602024-11-01T08:33:54.886ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37612024-11-01T08:33:54.888ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 192.06108ms iteration = 33 status = {"physical_disks_added":0}
37622024-11-01T08:33:54.924ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
37632024-11-01T08:33:54.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 227.385528ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
37642024-11-01T08:33:54.980ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37652024-11-01T08:33:54.980ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37662024-11-01T08:33:54.981ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "26d10f67-f3e7-4646-8816-7898a0b8919d", "content-length": "372", "date": "Fri, 01 Nov 2024 08:33:54 GMT"} })
37672024-11-01T08:33:54.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37682024-11-01T08:33:54.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37692024-11-01T08:33:54.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37702024-11-01T08:33:54.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37712024-11-01T08:33:54.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37722024-11-01T08:33:54.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37732024-11-01T08:33:55.026ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37742024-11-01T08:33:55.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
37752024-11-01T08:33:55.029ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37762024-11-01T08:33:55.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37772024-11-01T08:33:55.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37782024-11-01T08:33:55.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cfbea307-af3c-40fd-95dd-c9ca6b2d838d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
37792024-11-01T08:33:55.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cfbea307-af3c-40fd-95dd-c9ca6b2d838d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
37802024-11-01T08:33:55.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37812024-11-01T08:33:55.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37822024-11-01T08:33:55.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37832024-11-01T08:33:55.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = cfbea307-af3c-40fd-95dd-c9ca6b2d838d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
37842024-11-01T08:33:55.033ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
37852024-11-01T08:33:55.034ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "54a98e3b-4739-4d70-9dc4-7444348cac89", "date": "Fri, 01 Nov 2024 08:33:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37862024-11-01T08:33:55.034ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37872024-11-01T08:33:55.035ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8c022739-a9ac-4670-ab7a-b9d5dfc99ffb", "date": "Fri, 01 Nov 2024 08:33:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37882024-11-01T08:33:55.035ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37892024-11-01T08:33:55.037ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37902024-11-01T08:33:55.037ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 341.114103ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
37912024-11-01T08:33:55.040ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
37922024-11-01T08:33:55.040ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1a6211e1-bd03-4044-93cd-6a5868005875 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
37932024-11-01T08:33:55.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37942024-11-01T08:33:55.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37952024-11-01T08:33:55.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37962024-11-01T08:33:55.045ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37972024-11-01T08:33:55.045ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37982024-11-01T08:33:55.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37992024-11-01T08:33:55.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38002024-11-01T08:33:55.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38012024-11-01T08:33:55.046ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "79341513-9cf5-44d8-b0b5-c9d24149bcea", "date": "Fri, 01 Nov 2024 08:33:54 GMT"} })
38022024-11-01T08:33:55.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38032024-11-01T08:33:55.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38042024-11-01T08:33:55.050ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1a6211e1-bd03-4044-93cd-6a5868005875 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
38052024-11-01T08:33:55.050ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
38062024-11-01T08:33:55.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38072024-11-01T08:33:55.050ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 08:20:37.196977 UTC dns_group = internal generation = 1
38082024-11-01T08:33:55.050ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 354.299948ms iteration = 16 status = {"generation":1}
38092024-11-01T08:33:55.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38102024-11-01T08:33:55.053ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 357.593278ms iteration = 29 status = {}
38112024-11-01T08:33:55.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38122024-11-01T08:33:55.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38132024-11-01T08:33:55.059ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38142024-11-01T08:33:55.059ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38152024-11-01T08:33:55.060ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f74203a2-cf56-4047-95dd-f9f1faa18938", "date": "Fri, 01 Nov 2024 08:33:55 GMT"} })
38162024-11-01T08:33:55.061ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 365.066682ms iteration = 31 status = {}
38172024-11-01T08:33:55.062ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
38182024-11-01T08:33:55.073ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T08:19:51.214273Z, time_modified: 2024-11-01T08:19:51.214273Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f8c93fa7-6555-4906-9ff7-39adb002e287, db_silo: Silo { identity: SiloIdentity { id: f8c93fa7-6555-4906-9ff7-39adb002e287, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T08:20:37.795553Z, time_modified: 2024-11-01T08:20:37.795553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f8c93fa7-6555-4906-9ff7-39adb002e287, db_silo: Silo { identity: SiloIdentity { id: f8c93fa7-6555-4906-9ff7-39adb002e287, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T08:20:37.795553Z, time_modified: 2024-11-01T08:20:37.795553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372" }] }) }
38192024-11-01T08:33:55.073ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 377.309853ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f8c93fa7-6555-4906-9ff7-39adb002e287","tls_certs":["03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372"]}},"default_endpoint":{"silo_id":"f8c93fa7-6555-4906-9ff7-39adb002e287","tls_certs":["03babc94e4dbf62c3c95e62a06e35c5ce4a0570f699d20de6a096abd66c81372"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
38202024-11-01T08:33:55.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38212024-11-01T08:33:55.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38222024-11-01T08:33:55.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38232024-11-01T08:33:55.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38242024-11-01T08:33:55.095ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
38252024-11-01T08:33:55.095ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38262024-11-01T08:33:55.096ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3724639d-2f5c-49fb-ab5b-342a06201c32", "content-length": "26", "date": "Fri, 01 Nov 2024 08:33:54 GMT"} })
38272024-11-01T08:33:55.096ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38282024-11-01T08:33:55.098ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38292024-11-01T08:33:55.125ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 zone_address = fd00:1122:3344:101::2
38302024-11-01T08:33:55.125ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38312024-11-01T08:33:55.126ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f7a3b96-dc70-437b-aa94-86e219d9b128", "content-length": "26", "date": "Fri, 01 Nov 2024 08:33:54 GMT"} })
38322024-11-01T08:33:55.126ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38332024-11-01T08:33:55.127ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
38342024-11-01T08:33:55.204ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38352024-11-01T08:33:55.204ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e62cb194-c056-4d26-9263-2c4c61c0dc23", "content-length": "2", "date": "Fri, 01 Nov 2024 08:33:54 GMT"} })
38362024-11-01T08:33:55.206ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38372024-11-01T08:33:55.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38382024-11-01T08:33:55.208ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 512.459684ms iteration = 29 status = null
38392024-11-01T08:33:55.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
38402024-11-01T08:33:55.444ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38412024-11-01T08:33:55.460ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f9b021e-f085-4947-80a7-350ce826254f", "content-length": "691", "date": "Fri, 01 Nov 2024 08:33:55 GMT"} })
38422024-11-01T08:33:55.460ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
38432024-11-01T08:33:55.460ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
38442024-11-01T08:33:55.460ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
38452024-11-01T08:33:55.461ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 765.492693ms iteration = 30 status = {}
38462024-11-01T08:33:55.519ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
38472024-11-01T08:33:55.519ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5317da33-5a8e-4967-bd18-b401ee777d71", "date": "Fri, 01 Nov 2024 08:33:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
38482024-11-01T08:33:55.519ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
38492024-11-01T08:33:55.521ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "69153247-1308-4e08-9314-69ce3421f50b", "date": "Fri, 01 Nov 2024 08:33:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
38502024-11-01T08:33:55.521ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
38512024-11-01T08:33:55.524ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "788d8926-0d12-444e-9796-392dd6e84f4b", "date": "Fri, 01 Nov 2024 08:33:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
38522024-11-01T08:33:55.524ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
38532024-11-01T08:33:55.526ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
38542024-11-01T08:33:55.526ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 829.863494ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
38552024-11-01T08:33:55.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38562024-11-01T08:33:55.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38572024-11-01T08:33:55.569ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e2aedfd9-3b4d-40ab-920a-0ddf803678fe, rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a0c3e848-f136-4ae5-b986-95beae550c75) } rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
38582024-11-01T08:33:55.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38592024-11-01T08:33:55.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38602024-11-01T08:33:55.578ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38612024-11-01T08:33:55.578ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "400c9103-706f-41c1-a1b2-b77b1ed0c861", "content-length": "121", "date": "Fri, 01 Nov 2024 08:33:55 GMT"} })
38622024-11-01T08:33:55.578ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
38632024-11-01T08:33:55.578ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a0c3e848-f136-4ae5-b986-95beae550c75
38642024-11-01T08:33:55.579ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38652024-11-01T08:33:55.579ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38662024-11-01T08:33:55.579ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38672024-11-01T08:33:55.579ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38682024-11-01T08:33:55.579ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38692024-11-01T08:33:55.579ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38702024-11-01T08:33:55.579ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38712024-11-01T08:33:55.579ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38722024-11-01T08:33:55.579ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
38732024-11-01T08:33:55.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38742024-11-01T08:33:55.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38752024-11-01T08:33:55.581ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38762024-11-01T08:33:55.581ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc839ee7-2db1-4a19-ad1b-2909e6cb7fad", "content-length": "2", "date": "Fri, 01 Nov 2024 08:33:55 GMT"} })
38772024-11-01T08:33:55.581ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38782024-11-01T08:33:55.581ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d7fc473-e327-46aa-a455-60524fa27a7c", "content-length": "52", "date": "Fri, 01 Nov 2024 08:33:55 GMT"} })
38792024-11-01T08:33:55.581ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
38802024-11-01T08:33:55.581ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38812024-11-01T08:33:55.676ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5a55cf41-7922-4d32-864b-1a92ec204d72", "date": "Fri, 01 Nov 2024 08:33:54 GMT"} })
38822024-11-01T08:33:55.676ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch = Switch0
38832024-11-01T08:33:55.676ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38842024-11-01T08:33:55.677ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "20a6c2b0-0902-4c82-92a0-4e6689e13abc", "content-length": "669", "date": "Fri, 01 Nov 2024 08:33:54 GMT"} })
38852024-11-01T08:33:55.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38862024-11-01T08:33:55.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38872024-11-01T08:33:55.681ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38882024-11-01T08:33:55.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38892024-11-01T08:33:55.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38902024-11-01T08:33:55.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38912024-11-01T08:33:55.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38922024-11-01T08:33:55.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38932024-11-01T08:33:55.693ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 997.299628ms iteration = 29 status = {}
38942024-11-01T08:33:56.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7b453156-cde2-4508-a408-c20933b1938f roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
38952024-11-01T08:33:56.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7b453156-cde2-4508-a408-c20933b1938f resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
38962024-11-01T08:33:56.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7b453156-cde2-4508-a408-c20933b1938f response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
38972024-11-01T08:33:57.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b2406e9c-34a2-4e15-bff6-b476b3e22f8e roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
38982024-11-01T08:33:57.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b2406e9c-34a2-4e15-bff6-b476b3e22f8e resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
38992024-11-01T08:33:57.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b2406e9c-34a2-4e15-bff6-b476b3e22f8e response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39002024-11-01T08:33:58.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 165f80e2-7908-40ae-9fea-d76bd47d0893 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39012024-11-01T08:33:58.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 165f80e2-7908-40ae-9fea-d76bd47d0893 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39022024-11-01T08:33:58.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 165f80e2-7908-40ae-9fea-d76bd47d0893 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39032024-11-01T08:33:59.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b7a53433-cbc1-424f-9525-026aa04c134b roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39042024-11-01T08:33:59.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b7a53433-cbc1-424f-9525-026aa04c134b resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39052024-11-01T08:33:59.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b7a53433-cbc1-424f-9525-026aa04c134b response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39062024-11-01T08:34:00.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b32d7ba5-f4e9-4b43-965f-a4ab3050be76 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39072024-11-01T08:34:00.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b32d7ba5-f4e9-4b43-965f-a4ab3050be76 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39082024-11-01T08:34:00.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = b32d7ba5-f4e9-4b43-965f-a4ab3050be76 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39092024-11-01T08:34:01.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a2310c25-af76-4c7b-ac90-41ec2711db38 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39102024-11-01T08:34:01.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a2310c25-af76-4c7b-ac90-41ec2711db38 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39112024-11-01T08:34:01.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a2310c25-af76-4c7b-ac90-41ec2711db38 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39122024-11-01T08:34:01.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 82a2907e-97bd-4853-b5f6-6fb66b3cb943 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
39132024-11-01T08:34:01.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 82a2907e-97bd-4853-b5f6-6fb66b3cb943 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
39142024-11-01T08:34:01.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = 82a2907e-97bd-4853-b5f6-6fb66b3cb943 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
39152024-11-01T08:34:02.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3779f402-ebdb-42a7-b128-2b10aa93ee92 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39162024-11-01T08:34:02.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3779f402-ebdb-42a7-b128-2b10aa93ee92 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39172024-11-01T08:34:02.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3779f402-ebdb-42a7-b128-2b10aa93ee92 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39182024-11-01T08:34:03.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c59629c5-1dd2-4ce9-af90-d94b05464d88 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39192024-11-01T08:34:03.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c59629c5-1dd2-4ce9-af90-d94b05464d88 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39202024-11-01T08:34:03.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c59629c5-1dd2-4ce9-af90-d94b05464d88 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39212024-11-01T08:34:04.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f266ad37-adc8-4d8b-8010-900b8181a93a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39222024-11-01T08:34:04.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f266ad37-adc8-4d8b-8010-900b8181a93a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39232024-11-01T08:34:04.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f266ad37-adc8-4d8b-8010-900b8181a93a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39242024-11-01T08:34:04.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
39252024-11-01T08:34:04.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39262024-11-01T08:34:04.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39272024-11-01T08:34:04.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
39282024-11-01T08:34:04.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39292024-11-01T08:34:04.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39302024-11-01T08:34:04.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39312024-11-01T08:34:04.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39322024-11-01T08:34:04.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39332024-11-01T08:34:04.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39342024-11-01T08:34:04.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39352024-11-01T08:34:04.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39362024-11-01T08:34:04.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39372024-11-01T08:34:04.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39382024-11-01T08:34:04.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39392024-11-01T08:34:04.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
39402024-11-01T08:34:04.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39412024-11-01T08:34:04.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39422024-11-01T08:34:04.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
39432024-11-01T08:34:04.745ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.62251ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
39442024-11-01T08:34:04.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.791475ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39452024-11-01T08:34:05.200ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1390 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = c9da9628-41d4-44a3-ae4e-2d9cffcbd8b7 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
39462024-11-01T08:34:05.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c534ac4d-ac38-4171-a2d5-ff36c214930d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39472024-11-01T08:34:05.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c534ac4d-ac38-4171-a2d5-ff36c214930d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39482024-11-01T08:34:05.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c534ac4d-ac38-4171-a2d5-ff36c214930d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39492024-11-01T08:34:06.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2f008592-ebf9-4de9-9f6d-058d3130257c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39502024-11-01T08:34:06.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2f008592-ebf9-4de9-9f6d-058d3130257c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39512024-11-01T08:34:06.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2f008592-ebf9-4de9-9f6d-058d3130257c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39522024-11-01T08:34:07.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c0f7c7ba-bd0f-4159-ba0c-4ed2c555da40 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39532024-11-01T08:34:07.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c0f7c7ba-bd0f-4159-ba0c-4ed2c555da40 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39542024-11-01T08:34:07.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c0f7c7ba-bd0f-4159-ba0c-4ed2c555da40 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39552024-11-01T08:34:08.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7a0aa40b-4061-4047-b1b8-4cd1e123ce76 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39562024-11-01T08:34:08.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7a0aa40b-4061-4047-b1b8-4cd1e123ce76 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39572024-11-01T08:34:08.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 7a0aa40b-4061-4047-b1b8-4cd1e123ce76 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39582024-11-01T08:34:09.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a245fb57-f044-46cd-bc00-fc5f9ecc8e80 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39592024-11-01T08:34:09.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a245fb57-f044-46cd-bc00-fc5f9ecc8e80 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39602024-11-01T08:34:09.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = a245fb57-f044-46cd-bc00-fc5f9ecc8e80 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39612024-11-01T08:34:10.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 91009718-f450-4157-82ee-be9a295432b5 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39622024-11-01T08:34:10.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 91009718-f450-4157-82ee-be9a295432b5 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39632024-11-01T08:34:10.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 91009718-f450-4157-82ee-be9a295432b5 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39642024-11-01T08:34:11.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e61528bb-0164-48b1-a5f2-ec74611bb772 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39652024-11-01T08:34:11.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e61528bb-0164-48b1-a5f2-ec74611bb772 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39662024-11-01T08:34:11.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e61528bb-0164-48b1-a5f2-ec74611bb772 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39672024-11-01T08:34:12.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 69d27a79-987f-4ece-ac77-d045dbe3a607 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39682024-11-01T08:34:12.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 69d27a79-987f-4ece-ac77-d045dbe3a607 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39692024-11-01T08:34:12.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2717 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 69d27a79-987f-4ece-ac77-d045dbe3a607 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39702024-11-01T08:34:13.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8cb1733b-3bab-4df0-aaff-d491a8d43f72 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39712024-11-01T08:34:13.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8cb1733b-3bab-4df0-aaff-d491a8d43f72 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39722024-11-01T08:34:13.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8cb1733b-3bab-4df0-aaff-d491a8d43f72 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39732024-11-01T08:34:14.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 35bab08b-473a-48d5-9487-0307572bf8ee roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39742024-11-01T08:34:14.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 35bab08b-473a-48d5-9487-0307572bf8ee resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39752024-11-01T08:34:14.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2787 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 35bab08b-473a-48d5-9487-0307572bf8ee response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39762024-11-01T08:34:14.696ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
39772024-11-01T08:34:14.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39782024-11-01T08:34:14.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39792024-11-01T08:34:14.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
39802024-11-01T08:34:14.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39812024-11-01T08:34:14.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39822024-11-01T08:34:14.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39832024-11-01T08:34:14.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39842024-11-01T08:34:14.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.47892ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39852024-11-01T08:34:14.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-11-01T08:34:14.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39872024-11-01T08:34:14.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39882024-11-01T08:34:14.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39892024-11-01T08:34:14.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39902024-11-01T08:34:14.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39912024-11-01T08:34:14.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39922024-11-01T08:34:14.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
39932024-11-01T08:34:14.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39942024-11-01T08:34:14.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39952024-11-01T08:34:14.740ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
39962024-11-01T08:34:14.740ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.121204ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
39972024-11-01T08:34:15.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c62b7cc3-7b86-480f-bd9e-657d6e661af7 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39982024-11-01T08:34:15.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c62b7cc3-7b86-480f-bd9e-657d6e661af7 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
39992024-11-01T08:34:15.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c62b7cc3-7b86-480f-bd9e-657d6e661af7 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40002024-11-01T08:34:16.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8f659cd5-6312-4129-a263-9e1e5421fcd0 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40012024-11-01T08:34:16.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8f659cd5-6312-4129-a263-9e1e5421fcd0 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40022024-11-01T08:34:16.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 8f659cd5-6312-4129-a263-9e1e5421fcd0 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40032024-11-01T08:34:17.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 95a8ed08-f305-4e45-b8c6-e2d4d249fbfd roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40042024-11-01T08:34:17.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 95a8ed08-f305-4e45-b8c6-e2d4d249fbfd resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40052024-11-01T08:34:17.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 95a8ed08-f305-4e45-b8c6-e2d4d249fbfd response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40062024-11-01T08:34:18.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 28c8ee8f-a544-4e53-829b-30650a47ee82 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40072024-11-01T08:34:18.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 28c8ee8f-a544-4e53-829b-30650a47ee82 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40082024-11-01T08:34:18.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 28c8ee8f-a544-4e53-829b-30650a47ee82 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40092024-11-01T08:34:19.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e5ee15e5-b799-4d20-8ce2-7592fd5daf5c roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40102024-11-01T08:34:19.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e5ee15e5-b799-4d20-8ce2-7592fd5daf5c resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40112024-11-01T08:34:19.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = e5ee15e5-b799-4d20-8ce2-7592fd5daf5c response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40122024-11-01T08:34:20.203ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1455 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 20e1b529-1b8a-4d79-b9fd-ac0c2f11e6f2 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
40132024-11-01T08:34:20.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2fe2d94c-c0d0-4dee-9fb2-eafb7e79511a roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40142024-11-01T08:34:20.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2fe2d94c-c0d0-4dee-9fb2-eafb7e79511a resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40152024-11-01T08:34:20.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 2fe2d94c-c0d0-4dee-9fb2-eafb7e79511a response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40162024-11-01T08:34:21.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f39abacb-b951-402d-8adf-597797134e80 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40172024-11-01T08:34:21.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f39abacb-b951-402d-8adf-597797134e80 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40182024-11-01T08:34:21.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f39abacb-b951-402d-8adf-597797134e80 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40192024-11-01T08:34:22.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f26684ac-741b-464e-9ea3-174553a4897e roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40202024-11-01T08:34:22.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f26684ac-741b-464e-9ea3-174553a4897e resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40212024-11-01T08:34:22.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f26684ac-741b-464e-9ea3-174553a4897e response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40222024-11-01T08:34:23.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f5733fcc-45fd-420f-bf64-50a1cdcbd0a2 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40232024-11-01T08:34:23.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f5733fcc-45fd-420f-bf64-50a1cdcbd0a2 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40242024-11-01T08:34:23.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f5733fcc-45fd-420f-bf64-50a1cdcbd0a2 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
40252024-11-01T08:34:24.695ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
40262024-11-01T08:34:24.695ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
40272024-11-01T08:34:24.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40282024-11-01T08:34:24.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40292024-11-01T08:34:24.695ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
40302024-11-01T08:34:24.695ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
40312024-11-01T08:34:24.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40322024-11-01T08:34:24.695ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40332024-11-01T08:34:24.695ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
40342024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40352024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
40362024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
40372024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40382024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
40392024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
40402024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40412024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40422024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40432024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40442024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40452024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40462024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40472024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40482024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40492024-11-01T08:34:24.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40502024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
40512024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
40522024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40532024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.701\u{b5}s iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
40542024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
40552024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
40562024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.73\u{b5}s iteration = 30 status = {"errors":[],"records_set_to_done":[]}
40572024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
40582024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.03\u{b5}s iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40592024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
40602024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
40612024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.21\u{b5}s iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40622024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40632024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40642024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40652024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
40662024-11-01T08:34:24.697ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40672024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40682024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40692024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40702024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40712024-11-01T08:34:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40722024-11-01T08:34:24.698ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40732024-11-01T08:34:24.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40742024-11-01T08:34:24.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40752024-11-01T08:34:24.700ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.244034ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40762024-11-01T08:34:24.701ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5029, tv_nsec: 545993728 } })
40772024-11-01T08:34:24.701ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
40782024-11-01T08:34:24.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40792024-11-01T08:34:24.701ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40802024-11-01T08:34:24.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40812024-11-01T08:34:24.702ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5029, tv_nsec: 547090435 } })
40822024-11-01T08:34:24.702ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
40832024-11-01T08:34:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40842024-11-01T08:34:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40852024-11-01T08:34:24.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40862024-11-01T08:34:24.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40872024-11-01T08:34:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40882024-11-01T08:34:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40892024-11-01T08:34:24.705ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40902024-11-01T08:34:24.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40912024-11-01T08:34:24.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40922024-11-01T08:34:24.706ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40932024-11-01T08:34:24.706ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40942024-11-01T08:34:24.706ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40952024-11-01T08:34:24.706ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40962024-11-01T08:34:24.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40972024-11-01T08:34:24.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40982024-11-01T08:34:24.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40992024-11-01T08:34:24.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41002024-11-01T08:34:24.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41012024-11-01T08:34:24.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41022024-11-01T08:34:24.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41032024-11-01T08:34:24.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41042024-11-01T08:34:24.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41052024-11-01T08:34:24.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41062024-11-01T08:34:24.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41072024-11-01T08:34:24.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41082024-11-01T08:34:24.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41092024-11-01T08:34:24.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41102024-11-01T08:34:24.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41112024-11-01T08:34:24.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41122024-11-01T08:34:24.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41132024-11-01T08:34:24.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41142024-11-01T08:34:24.716ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41152024-11-01T08:34:24.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41162024-11-01T08:34:24.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41172024-11-01T08:34:24.717ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41182024-11-01T08:34:24.720ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f7fe3bf0-db6a-428d-8129-f334aa61483d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5029, tv_nsec: 564947453 } })
41192024-11-01T08:34:24.720ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
41202024-11-01T08:34:24.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41212024-11-01T08:34:24.720ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41222024-11-01T08:34:24.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41232024-11-01T08:34:24.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 928244ab-f10c-4db6-9ffd-89411d7293da roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
41242024-11-01T08:34:24.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 928244ab-f10c-4db6-9ffd-89411d7293da resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
41252024-11-01T08:34:24.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 928244ab-f10c-4db6-9ffd-89411d7293da response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
41262024-11-01T08:34:24.743ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41272024-11-01T08:34:24.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41282024-11-01T08:34:24.746ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41292024-11-01T08:34:24.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41302024-11-01T08:34:24.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.175045ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41312024-11-01T08:34:24.756ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41322024-11-01T08:34:24.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41332024-11-01T08:34:24.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41342024-11-01T08:34:24.758ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41352024-11-01T08:34:24.758ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.4681ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41362024-11-01T08:34:24.765ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41372024-11-01T08:34:24.765ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41382024-11-01T08:34:24.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41392024-11-01T08:34:24.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41402024-11-01T08:34:24.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
41412024-11-01T08:34:24.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41422024-11-01T08:34:24.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41432024-11-01T08:34:24.781ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
41442024-11-01T08:34:24.781ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.516801ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
41452024-11-01T08:34:24.782ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.998088ms iteration = 34 status = {"physical_disks_added":0}
41462024-11-01T08:34:24.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41472024-11-01T08:34:24.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41482024-11-01T08:34:24.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41492024-11-01T08:34:24.796ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
41502024-11-01T08:34:24.796ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41512024-11-01T08:34:24.797ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f0c444b-90a2-41ee-b0b8-13b3fce5aded", "content-length": "26", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
41522024-11-01T08:34:24.797ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41532024-11-01T08:34:24.798ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41542024-11-01T08:34:24.798ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
41552024-11-01T08:34:24.798ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41562024-11-01T08:34:24.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f7fe3bf0-db6a-428d-8129-f334aa61483d, lookup_type: ById(f7fe3bf0-db6a-428d-8129-f334aa61483d) } result = Ok(())
41572024-11-01T08:34:24.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41582024-11-01T08:34:24.799ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "90f84c15-7246-4672-881c-28d989c39595", "content-length": "26", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
41592024-11-01T08:34:24.799ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41602024-11-01T08:34:24.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41612024-11-01T08:34:24.800ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41622024-11-01T08:34:24.800ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.96511ms iteration = 30 status = 0
41632024-11-01T08:34:24.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 109.388198ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41642024-11-01T08:34:24.809ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41652024-11-01T08:34:24.809ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41662024-11-01T08:34:24.809ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 112.018103ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41672024-11-01T08:34:24.829ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 zone_address = fd00:1122:3344:101::2
41682024-11-01T08:34:24.829ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41692024-11-01T08:34:24.830ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f016da4f-fd4b-4f8d-93bd-1819c4ec4ebd", "content-length": "26", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
41702024-11-01T08:34:24.830ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41712024-11-01T08:34:24.832ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
41722024-11-01T08:34:24.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41732024-11-01T08:34:24.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41742024-11-01T08:34:24.908ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41752024-11-01T08:34:24.909ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "838de473-8a47-4416-a5cc-e42e49c8867a", "content-length": "2", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
41762024-11-01T08:34:24.910ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41772024-11-01T08:34:24.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41782024-11-01T08:34:24.910ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 214.83756ms iteration = 30 status = {}
41792024-11-01T08:34:24.911ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41802024-11-01T08:34:24.911ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41812024-11-01T08:34:24.912ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4bf4ac0-9fc7-4b68-b36a-cdb7923b1c66", "content-length": "372", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
41822024-11-01T08:34:24.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41832024-11-01T08:34:24.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41842024-11-01T08:34:24.913ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41852024-11-01T08:34:24.914ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 218.663884ms iteration = 30 status = null
41862024-11-01T08:34:24.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41872024-11-01T08:34:24.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41882024-11-01T08:34:24.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41892024-11-01T08:34:24.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902024-11-01T08:34:24.960ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41912024-11-01T08:34:24.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41922024-11-01T08:34:24.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41932024-11-01T08:34:24.973ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
41942024-11-01T08:34:24.973ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41952024-11-01T08:34:24.973ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d6f8eb9e-556e-46e1-aff5-b1a658551623", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
41962024-11-01T08:34:24.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41972024-11-01T08:34:24.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41982024-11-01T08:34:24.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41992024-11-01T08:34:24.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42002024-11-01T08:34:24.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42012024-11-01T08:34:24.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42022024-11-01T08:34:24.990ZINFOnexus (BackgroundTasks): VPC route manager sled f7fe3bf0-db6a-428d-8129-f334aa61483d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42032024-11-01T08:34:24.990ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42042024-11-01T08:34:24.991ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "38974332-c0a6-4414-ae1a-5e518fa3a376", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
42052024-11-01T08:34:24.993ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.052126ms iteration = 32 status = {}
42062024-11-01T08:34:25.033ZDEBGnexus (BackgroundTasks): client request SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42072024-11-01T08:34:25.033ZDEBGnexus (BackgroundTasks): client response SledAgent = f7fe3bf0-db6a-428d-8129-f334aa61483d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "07808994-daf0-4cac-a8e6-8996e0f05a9f", "content-length": "691", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
42082024-11-01T08:34:25.033ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
42092024-11-01T08:34:25.033ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
42102024-11-01T08:34:25.033ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
42112024-11-01T08:34:25.035ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 339.920414ms iteration = 31 status = {}
42122024-11-01T08:34:25.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42132024-11-01T08:34:25.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42142024-11-01T08:34:25.039ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e2aedfd9-3b4d-40ab-920a-0ddf803678fe, rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a0c3e848-f136-4ae5-b986-95beae550c75) } rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
42152024-11-01T08:34:25.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42162024-11-01T08:34:25.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42172024-11-01T08:34:25.048ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42182024-11-01T08:34:25.049ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffbcb377-460a-4d26-ba0c-f63807a150f5", "content-length": "121", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
42192024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
42202024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a0c3e848-f136-4ae5-b986-95beae550c75
42212024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42222024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42232024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42242024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42252024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42262024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42272024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42282024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42292024-11-01T08:34:25.049ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790
42302024-11-01T08:34:25.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42312024-11-01T08:34:25.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42322024-11-01T08:34:25.051ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42332024-11-01T08:34:25.051ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac0f2983-c8ca-4d1e-8b89-67df667d8382", "content-length": "2", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
42342024-11-01T08:34:25.051ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42352024-11-01T08:34:25.052ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fe57248-3ee5-4f32-adae-e3236db16ce4", "content-length": "52", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
42362024-11-01T08:34:25.052ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch_location = Switch0
42372024-11-01T08:34:25.052ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42382024-11-01T08:34:25.167ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "402994e3-36f5-4e14-9712-d5b2f81921a2", "date": "Fri, 01 Nov 2024 08:34:24 GMT"} })
42392024-11-01T08:34:25.167ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 switch = Switch0
42402024-11-01T08:34:25.167ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42412024-11-01T08:34:25.167ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8166ec96-9c84-4ebd-9efb-796280106790 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7326f8d-72e0-4b1f-b4d8-f06ba0b649ac", "content-length": "669", "date": "Fri, 01 Nov 2024 08:34:25 GMT"} })
42422024-11-01T08:34:25.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42432024-11-01T08:34:25.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42442024-11-01T08:34:25.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42452024-11-01T08:34:25.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42462024-11-01T08:34:25.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42472024-11-01T08:34:25.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42482024-11-01T08:34:25.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42492024-11-01T08:34:25.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42502024-11-01T08:34:25.185ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.428118ms iteration = 30 status = {}
42512024-11-01T08:34:25.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f28a6dd4-4e0b-49fb-a632-bba80d260f10 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42522024-11-01T08:34:25.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f28a6dd4-4e0b-49fb-a632-bba80d260f10 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42532024-11-01T08:34:25.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = f28a6dd4-4e0b-49fb-a632-bba80d260f10 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42542024-11-01T08:34:26.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 97007b65-6442-4c26-a3e5-6b61a2e1e6c7 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42552024-11-01T08:34:26.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 97007b65-6442-4c26-a3e5-6b61a2e1e6c7 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42562024-11-01T08:34:26.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 97007b65-6442-4c26-a3e5-6b61a2e1e6c7 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42572024-11-01T08:34:27.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 713f8d72-75f8-4efc-bb7c-41aa06a2ca07 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42582024-11-01T08:34:27.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 713f8d72-75f8-4efc-bb7c-41aa06a2ca07 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42592024-11-01T08:34:27.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 713f8d72-75f8-4efc-bb7c-41aa06a2ca07 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42602024-11-01T08:34:28.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 905bdb35-587c-41bc-b7c4-66ff1d04edc2 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42612024-11-01T08:34:28.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 905bdb35-587c-41bc-b7c4-66ff1d04edc2 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42622024-11-01T08:34:28.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 905bdb35-587c-41bc-b7c4-66ff1d04edc2 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42632024-11-01T08:34:29.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 82dee352-e2d7-4884-869d-992babe9a268 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42642024-11-01T08:34:29.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 82dee352-e2d7-4884-869d-992babe9a268 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42652024-11-01T08:34:29.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 82dee352-e2d7-4884-869d-992babe9a268 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42662024-11-01T08:34:30.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = db90b379-9968-41da-96f3-a9af9ac17ef5 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42672024-11-01T08:34:30.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = db90b379-9968-41da-96f3-a9af9ac17ef5 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42682024-11-01T08:34:30.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = db90b379-9968-41da-96f3-a9af9ac17ef5 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42692024-11-01T08:34:31.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = bf92f7e3-e20d-4536-8106-2256e1dbcbe1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
42702024-11-01T08:34:31.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = bf92f7e3-e20d-4536-8106-2256e1dbcbe1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
42712024-11-01T08:34:31.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43681 req_id = bf92f7e3-e20d-4536-8106-2256e1dbcbe1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
42722024-11-01T08:34:31.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = df7a4d9a-6e8d-4eea-975f-451dd218e2c2 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42732024-11-01T08:34:31.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = df7a4d9a-6e8d-4eea-975f-451dd218e2c2 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42742024-11-01T08:34:31.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = df7a4d9a-6e8d-4eea-975f-451dd218e2c2 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42752024-11-01T08:34:32.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 07a82536-2785-4e31-ba05-c313a8ebe30b roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42762024-11-01T08:34:32.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 07a82536-2785-4e31-ba05-c313a8ebe30b resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42772024-11-01T08:34:32.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 07a82536-2785-4e31-ba05-c313a8ebe30b response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42782024-11-01T08:34:33.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 46cdea84-5cc3-4465-ae3d-f2a98c730ce9 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42792024-11-01T08:34:33.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 46cdea84-5cc3-4465-ae3d-f2a98c730ce9 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42802024-11-01T08:34:33.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 46cdea84-5cc3-4465-ae3d-f2a98c730ce9 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
42812024-11-01T08:34:34.695ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
42822024-11-01T08:34:34.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42832024-11-01T08:34:34.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42842024-11-01T08:34:34.696ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
42852024-11-01T08:34:34.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42862024-11-01T08:34:34.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42872024-11-01T08:34:34.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42882024-11-01T08:34:34.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42892024-11-01T08:34:34.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42902024-11-01T08:34:34.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42912024-11-01T08:34:34.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42922024-11-01T08:34:34.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42932024-11-01T08:34:34.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42942024-11-01T08:34:34.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42952024-11-01T08:34:34.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.439182ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42962024-11-01T08:34:34.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42972024-11-01T08:34:34.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32cc3e12-f29c-4c32-9a43-cefe71752876, lookup_type: ById(32cc3e12-f29c-4c32-9a43-cefe71752876) } result = Ok(())
42982024-11-01T08:34:34.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42992024-11-01T08:34:34.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43002024-11-01T08:34:34.741ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 original_time_created = 2024-11-01 08:19:42.547271 UTC target_id = 32cc3e12-f29c-4c32-9a43-cefe71752876 time_created = 2024-11-01 08:19:42.547271 UTC
43012024-11-01T08:34:34.741ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.034201ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32cc3e12-f29c-4c32-9a43-cefe71752876","time_created":"2024-11-01T08:19:42.547271Z"}
43022024-11-01T08:34:34.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 443b5ed7-4c9d-4fc0-9837-53cd3ab5927d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43032024-11-01T08:34:34.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 443b5ed7-4c9d-4fc0-9837-53cd3ab5927d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43042024-11-01T08:34:34.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 443b5ed7-4c9d-4fc0-9837-53cd3ab5927d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43052024-11-01T08:34:35.202ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:48078 method = GET remote_addr = [fd00:1122:3344:101::d]:41660 req_id = 792e512f-94b2-4304-9530-7561da99e611 response_code = 200 uri = /6faaa15b-0dc5-4caa-9f63-b47fef16cf54
43062024-11-01T08:34:36.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 80667da8-483e-4cf7-89ad-f5b8d0e2edd8 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43072024-11-01T08:34:36.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 80667da8-483e-4cf7-89ad-f5b8d0e2edd8 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43082024-11-01T08:34:36.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 80667da8-483e-4cf7-89ad-f5b8d0e2edd8 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43092024-11-01T08:34:37.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 305d2d02-4fec-446e-b4b4-15c41629087d roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43102024-11-01T08:34:37.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 305d2d02-4fec-446e-b4b4-15c41629087d resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43112024-11-01T08:34:37.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 305d2d02-4fec-446e-b4b4-15c41629087d response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43122024-11-01T08:34:38.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3f95a096-e89a-466d-9266-8c3908239fe1 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43132024-11-01T08:34:38.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3f95a096-e89a-466d-9266-8c3908239fe1 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43142024-11-01T08:34:38.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 3f95a096-e89a-466d-9266-8c3908239fe1 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43152024-11-01T08:34:39.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 45bfbda5-ec93-42c9-94b9-0e3c047769fd roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43162024-11-01T08:34:39.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 45bfbda5-ec93-42c9-94b9-0e3c047769fd resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43172024-11-01T08:34:39.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 45bfbda5-ec93-42c9-94b9-0e3c047769fd response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43182024-11-01T08:34:40.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 478002ad-6684-4351-8be5-b0bbf346f050 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43192024-11-01T08:34:40.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 478002ad-6684-4351-8be5-b0bbf346f050 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43202024-11-01T08:34:40.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = 478002ad-6684-4351-8be5-b0bbf346f050 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43212024-11-01T08:34:41.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c8ff1db1-02e4-4793-8825-0e302d626859 roles = RoleSet { roles: {} } uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43222024-11-01T08:34:41.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c8ff1db1-02e4-4793-8825-0e302d626859 resource = Database result = Ok(()) uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d
43232024-11-01T08:34:41.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35032 req_id = c8ff1db1-02e4-4793-8825-0e302d626859 response_code = 200 uri = /probes/f7fe3bf0-db6a-428d-8129-f334aa61483d