Max level shown:
12024-12-07T01:00:02.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0ef54dd7-d030-4efd-ae8e-07dc933f465b roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
22024-12-07T01:00:02.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0ef54dd7-d030-4efd-ae8e-07dc933f465b resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
32024-12-07T01:00:02.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0ef54dd7-d030-4efd-ae8e-07dc933f465b response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
42024-12-07T01:00:03.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 54b14aa9-905d-472b-8e23-8d77b3d5fc3b roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
52024-12-07T01:00:03.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 54b14aa9-905d-472b-8e23-8d77b3d5fc3b resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
62024-12-07T01:00:03.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 54b14aa9-905d-472b-8e23-8d77b3d5fc3b response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
72024-12-07T01:00:05.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 4d1a21ca-5e0d-4b3b-a2da-dafba1905fa6 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
82024-12-07T01:00:05.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 4d1a21ca-5e0d-4b3b-a2da-dafba1905fa6 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
92024-12-07T01:00:05.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 4d1a21ca-5e0d-4b3b-a2da-dafba1905fa6 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
102024-12-07T01:00:05.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 7cb7459f-bdb6-446b-87c7-b455203b814e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
112024-12-07T01:00:05.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 7cb7459f-bdb6-446b-87c7-b455203b814e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
122024-12-07T01:00:05.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 7cb7459f-bdb6-446b-87c7-b455203b814e response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
132024-12-07T01:00:06.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 241f410b-6fdc-4d6a-965f-84722e181e0f roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
142024-12-07T01:00:06.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 241f410b-6fdc-4d6a-965f-84722e181e0f resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
152024-12-07T01:00:06.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 241f410b-6fdc-4d6a-965f-84722e181e0f response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
162024-12-07T01:00:06.765ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
172024-12-07T01:00:06.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
182024-12-07T01:00:06.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192024-12-07T01:00:06.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
202024-12-07T01:00:06.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
212024-12-07T01:00:06.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
222024-12-07T01:00:06.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
232024-12-07T01:00:06.768ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
242024-12-07T01:00:06.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
252024-12-07T01:00:06.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.755394ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
262024-12-07T01:00:06.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
272024-12-07T01:00:06.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
282024-12-07T01:00:06.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
292024-12-07T01:00:06.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
302024-12-07T01:00:06.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
312024-12-07T01:00:06.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
322024-12-07T01:00:06.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
332024-12-07T01:00:06.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
342024-12-07T01:00:06.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
352024-12-07T01:00:06.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
362024-12-07T01:00:06.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.146877ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
372024-12-07T01:00:07.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 68824769-f996-4053-b0ed-e1c6588af89f roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
382024-12-07T01:00:07.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 68824769-f996-4053-b0ed-e1c6588af89f resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
392024-12-07T01:00:07.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 68824769-f996-4053-b0ed-e1c6588af89f response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
402024-12-07T01:00:07.185ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1410 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = 456903f1-fe0c-497b-a27d-45a5e3ded53b response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
412024-12-07T01:00:08.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 069ab557-50f7-4869-a0a6-0529ad935f98 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
422024-12-07T01:00:08.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 069ab557-50f7-4869-a0a6-0529ad935f98 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
432024-12-07T01:00:08.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 069ab557-50f7-4869-a0a6-0529ad935f98 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
442024-12-07T01:00:09.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = eda0c858-94fc-4e65-96bf-b8f5856a0667 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
452024-12-07T01:00:09.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = eda0c858-94fc-4e65-96bf-b8f5856a0667 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
462024-12-07T01:00:09.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = eda0c858-94fc-4e65-96bf-b8f5856a0667 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
472024-12-07T01:00:10.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = e46f49fd-543c-4406-b122-3a44319f2abb roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
482024-12-07T01:00:10.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = e46f49fd-543c-4406-b122-3a44319f2abb resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
492024-12-07T01:00:10.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = e46f49fd-543c-4406-b122-3a44319f2abb response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
502024-12-07T01:00:11.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = da303c34-55f4-43be-9857-4409da152047 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
512024-12-07T01:00:11.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = da303c34-55f4-43be-9857-4409da152047 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
522024-12-07T01:00:11.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = da303c34-55f4-43be-9857-4409da152047 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
532024-12-07T01:00:12.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1b68b48d-f0cb-4a37-acde-2a881fd50ca1 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
542024-12-07T01:00:12.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1b68b48d-f0cb-4a37-acde-2a881fd50ca1 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
552024-12-07T01:00:12.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1b68b48d-f0cb-4a37-acde-2a881fd50ca1 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
562024-12-07T01:00:13.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 105811f7-d3cd-4d5c-b4e8-27b1465413bf roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
572024-12-07T01:00:13.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 105811f7-d3cd-4d5c-b4e8-27b1465413bf resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
582024-12-07T01:00:13.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 105811f7-d3cd-4d5c-b4e8-27b1465413bf response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
592024-12-07T01:00:14.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 5a657b87-194e-48d7-a2d9-8b94d8a91d25 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
602024-12-07T01:00:14.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 5a657b87-194e-48d7-a2d9-8b94d8a91d25 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
612024-12-07T01:00:14.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 5a657b87-194e-48d7-a2d9-8b94d8a91d25 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
622024-12-07T01:00:15.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = e22e027b-df9d-4b6d-8df7-fb5008708d36 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
632024-12-07T01:00:15.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = e22e027b-df9d-4b6d-8df7-fb5008708d36 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
642024-12-07T01:00:15.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = e22e027b-df9d-4b6d-8df7-fb5008708d36 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
652024-12-07T01:00:16.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 16b23726-77ee-48c3-a2f1-5abd32b362a8 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
662024-12-07T01:00:16.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 16b23726-77ee-48c3-a2f1-5abd32b362a8 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
672024-12-07T01:00:16.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 16b23726-77ee-48c3-a2f1-5abd32b362a8 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
682024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
692024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
702024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
712024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
722024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
732024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
742024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
752024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
762024-12-07T01:00:16.765ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
772024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
782024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
792024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
802024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
812024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
822024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
832024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
842024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
852024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
862024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
872024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
882024-12-07T01:00:16.765ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-07 00:50:16.765448074 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
892024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
902024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
912024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
922024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
932024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
942024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
952024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
962024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
972024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
982024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
992024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1002024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1012024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1022024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1032024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1042024-12-07T01:00:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1052024-12-07T01:00:16.765ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eda26d3e-18ec-4c21-8ff4-73abfd373bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fe4d45f4-708c-423b-9b9c-06a074a360b5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fe4d45f4-708c-423b-9b9c-06a074a360b5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4479, tv_nsec: 991079008 } })
1062024-12-07T01:00:16.765ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5661fac0-67b8-45f8-869a-67dd3e21bd0b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be11a55e-cb67-4535-ad44-b9a4d4586728.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd72061d-6779-40de-8011-8e899981c9e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd72061d-6779-40de-8011-8e899981c9e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 4479, tv_nsec: 991094308 } })
1072024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1082024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1092024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1102024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
1112024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
1122024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1132024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1142024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
1152024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1162024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
1172024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
1182024-12-07T01:00:16.766ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70
1192024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
1202024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1212024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.541\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70"}
1222024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1232024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1242024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
1252024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
1262024-12-07T01:00:16.766ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1272024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1282024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1292024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
1302024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1312024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
1322024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1332024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
1342024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1352024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
1362024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1372024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
1382024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1392024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1402024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1412024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1422024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1432024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1442024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1452024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1462024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1472024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1482024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.214344ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1492024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1502024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1512024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1522024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1532024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1542024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.255675ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1552024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1562024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1572024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1582024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1592024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1602024-12-07T01:00:16.766ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1612024-12-07T01:00:16.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1622024-12-07T01:00:16.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1632024-12-07T01:00:16.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1642024-12-07T01:00:16.767ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4479, tv_nsec: 993090127 } })
1652024-12-07T01:00:16.768ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
1662024-12-07T01:00:16.768ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
1672024-12-07T01:00:16.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1682024-12-07T01:00:16.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1692024-12-07T01:00:16.768ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
1702024-12-07T01:00:16.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1712024-12-07T01:00:16.768ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1722024-12-07T01:00:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1732024-12-07T01:00:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1742024-12-07T01:00:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1752024-12-07T01:00:16.769ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4479, tv_nsec: 994144258 } })
1762024-12-07T01:00:16.769ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1772024-12-07T01:00:16.769ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1782024-12-07T01:00:16.769ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.938968ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1792024-12-07T01:00:16.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1802024-12-07T01:00:16.770ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-07 00:50:16.765448074 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1812024-12-07T01:00:16.770ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.693823ms iteration = 13 status = {"expiration":"2024-12-07T00:50:16.765448074Z","pruned":[]}
1822024-12-07T01:00:16.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1832024-12-07T01:00:16.770ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1842024-12-07T01:00:16.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1852024-12-07T01:00:16.771ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1862024-12-07T01:00:16.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1872024-12-07T01:00:16.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1882024-12-07T01:00:16.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1892024-12-07T01:00:16.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1902024-12-07T01:00:16.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1912024-12-07T01:00:16.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1922024-12-07T01:00:16.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1932024-12-07T01:00:16.773ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1942024-12-07T01:00:16.773ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1952024-12-07T01:00:16.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1962024-12-07T01:00:16.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1972024-12-07T01:00:16.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1982024-12-07T01:00:16.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1992024-12-07T01:00:16.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2002024-12-07T01:00:16.776ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2012024-12-07T01:00:16.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2022024-12-07T01:00:16.776ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2032024-12-07T01:00:16.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2042024-12-07T01:00:16.776ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.385735ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
2052024-12-07T01:00:16.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2062024-12-07T01:00:16.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2072024-12-07T01:00:16.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2082024-12-07T01:00:16.778ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2092024-12-07T01:00:16.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2102024-12-07T01:00:16.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2112024-12-07T01:00:16.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2122024-12-07T01:00:16.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2132024-12-07T01:00:16.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2142024-12-07T01:00:16.781ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2152024-12-07T01:00:16.781ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2162024-12-07T01:00:16.781ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2172024-12-07T01:00:16.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2182024-12-07T01:00:16.782ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2192024-12-07T01:00:16.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2202024-12-07T01:00:16.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2212024-12-07T01:00:16.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2222024-12-07T01:00:16.784ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2232024-12-07T01:00:16.784ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2242024-12-07T01:00:16.784ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.641847ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2252024-12-07T01:00:16.784ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2262024-12-07T01:00:16.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2272024-12-07T01:00:16.787ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2282024-12-07T01:00:16.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2292024-12-07T01:00:16.787ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2302024-12-07T01:00:16.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2312024-12-07T01:00:16.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2322024-12-07T01:00:16.787ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2332024-12-07T01:00:16.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2342024-12-07T01:00:16.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2352024-12-07T01:00:16.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2362024-12-07T01:00:16.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2372024-12-07T01:00:16.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2382024-12-07T01:00:16.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2392024-12-07T01:00:16.791ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2402024-12-07T01:00:16.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2412024-12-07T01:00:16.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2422024-12-07T01:00:16.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2432024-12-07T01:00:16.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2442024-12-07T01:00:16.795ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2452024-12-07T01:00:16.795ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2462024-12-07T01:00:16.795ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 30.164704ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2472024-12-07T01:00:16.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2482024-12-07T01:00:16.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2492024-12-07T01:00:16.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2502024-12-07T01:00:16.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2512024-12-07T01:00:16.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2522024-12-07T01:00:16.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2532024-12-07T01:00:16.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2542024-12-07T01:00:16.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2552024-12-07T01:00:16.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2562024-12-07T01:00:16.801ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2572024-12-07T01:00:16.801ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2582024-12-07T01:00:16.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2592024-12-07T01:00:16.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2602024-12-07T01:00:16.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4480, tv_nsec: 27281381 } })
2612024-12-07T01:00:16.802ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
2622024-12-07T01:00:16.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2632024-12-07T01:00:16.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2642024-12-07T01:00:16.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2652024-12-07T01:00:16.804ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 39.120471ms iteration = 6 status = {"nsuccess":5}
2662024-12-07T01:00:16.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2672024-12-07T01:00:16.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2682024-12-07T01:00:16.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2692024-12-07T01:00:16.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2702024-12-07T01:00:16.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2712024-12-07T01:00:16.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2722024-12-07T01:00:16.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2732024-12-07T01:00:16.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2742024-12-07T01:00:16.813ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2752024-12-07T01:00:16.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2762024-12-07T01:00:16.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.441352ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2772024-12-07T01:00:16.825ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2782024-12-07T01:00:16.825ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2792024-12-07T01:00:16.825ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2802024-12-07T01:00:16.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2812024-12-07T01:00:16.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2822024-12-07T01:00:16.827ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2832024-12-07T01:00:16.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2842024-12-07T01:00:16.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.400681ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
2852024-12-07T01:00:16.832ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2862024-12-07T01:00:16.832ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2872024-12-07T01:00:16.832ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2882024-12-07T01:00:16.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2892024-12-07T01:00:16.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2902024-12-07T01:00:16.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2912024-12-07T01:00:16.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2922024-12-07T01:00:16.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.658494ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
2932024-12-07T01:00:16.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2942024-12-07T01:00:16.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2952024-12-07T01:00:16.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2962024-12-07T01:00:16.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2972024-12-07T01:00:16.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2982024-12-07T01:00:16.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2992024-12-07T01:00:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3002024-12-07T01:00:16.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3012024-12-07T01:00:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3022024-12-07T01:00:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.158369ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3032024-12-07T01:00:16.853ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3042024-12-07T01:00:16.853ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3052024-12-07T01:00:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 87.788772ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3062024-12-07T01:00:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
3072024-12-07T01:00:16.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3082024-12-07T01:00:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3092024-12-07T01:00:16.861ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 96.501093ms iteration = 29 status = {"physical_disks_added":0}
3102024-12-07T01:00:16.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3112024-12-07T01:00:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3122024-12-07T01:00:16.940ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3132024-12-07T01:00:16.940ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3142024-12-07T01:00:16.940ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcd34be9-c76d-46be-b8ad-98a36e311e8e", "content-length": "26", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} })
3152024-12-07T01:00:16.940ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3162024-12-07T01:00:16.942ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3172024-12-07T01:00:17.015ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3182024-12-07T01:00:17.015ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3192024-12-07T01:00:17.016ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "691a8177-cebd-4812-b573-39cda0a31f32", "content-length": "26", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} })
3202024-12-07T01:00:17.016ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3212024-12-07T01:00:17.017ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3222024-12-07T01:00:17.019ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3232024-12-07T01:00:17.034ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3242024-12-07T01:00:17.159ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221/state
3252024-12-07T01:00:17.160ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "a71e5732-4f70-41ec-9b70-49530be0b866", "content-length": "130", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} })
3262024-12-07T01:00:17.160ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = d4e357bc-806f-4b64-837e-f3433fef287e sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-07T00:59:43.830514997Z }, migration_in: None, migration_out: None } vmm_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
3272024-12-07T01:00:17.160ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 vmm_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-07T00:59:43.830514997Z }
3282024-12-07T01:00:17.160ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = d4e357bc-806f-4b64-837e-f3433fef287e roles = RoleSet { roles: {} } sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 vmm_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
3292024-12-07T01:00:17.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = d4e357bc-806f-4b64-837e-f3433fef287e resource = Database result = Ok(()) sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 vmm_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
3302024-12-07T01:00:17.170ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3312024-12-07T01:00:17.170ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3322024-12-07T01:00:17.171ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "20f8536b-67ae-4d65-a1ad-68198bcae43d", "content-length": "583", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} })
3332024-12-07T01:00:17.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3342024-12-07T01:00:17.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3352024-12-07T01:00:17.171ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 406.422884ms iteration = 25 status = {}
3362024-12-07T01:00:17.174ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a zone_address = fd00:1122:3344:101::2
3372024-12-07T01:00:17.174ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3382024-12-07T01:00:17.174ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7fbf8e6-75b0-42c9-9ba3-47d4e944a824", "content-length": "26", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} })
3392024-12-07T01:00:17.174ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3402024-12-07T01:00:17.176ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
3412024-12-07T01:00:17.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3422024-12-07T01:00:17.178ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3432024-12-07T01:00:17.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3442024-12-07T01:00:17.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3452024-12-07T01:00:17.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3462024-12-07T01:00:17.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3472024-12-07T01:00:17.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3482024-12-07T01:00:17.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3492024-12-07T01:00:17.187ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = 8ae721a0-7bc0-425d-8070-e925cdeb7c93 response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
3502024-12-07T01:00:17.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3512024-12-07T01:00:17.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3, lookup_type: ById(e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) } result = Ok(())
3522024-12-07T01:00:17.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3532024-12-07T01:00:17.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3542024-12-07T01:00:17.194ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 428.754785ms iteration = 25 status = 0
3552024-12-07T01:00:17.207ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3562024-12-07T01:00:17.207ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "33e990cc-80ae-4f5b-b292-e9b72637ee42", "content-length": "1", "date": "Sat, 07 Dec 2024 01:00:17 GMT"} })
3572024-12-07T01:00:17.209ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3582024-12-07T01:00:17.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3592024-12-07T01:00:17.210ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
3602024-12-07T01:00:17.210ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 444.981354ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
3612024-12-07T01:00:17.212ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 447.029195ms iteration = 25 status = null
3622024-12-07T01:00:17.221ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3632024-12-07T01:00:17.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3642024-12-07T01:00:17.224ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3652024-12-07T01:00:17.226ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3662024-12-07T01:00:17.226ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3672024-12-07T01:00:17.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3682024-12-07T01:00:17.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 459.147094ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3692024-12-07T01:00:17.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 465.196443ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3702024-12-07T01:00:17.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3712024-12-07T01:00:17.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3722024-12-07T01:00:17.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3732024-12-07T01:00:17.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3742024-12-07T01:00:17.242ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3752024-12-07T01:00:17.246ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3762024-12-07T01:00:17.246ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 52ba8747-d0f6-43d9-9ec0-995aa6df639a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3772024-12-07T01:00:17.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3782024-12-07T01:00:17.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3792024-12-07T01:00:17.247ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
3802024-12-07T01:00:17.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3812024-12-07T01:00:17.249ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 483.641967ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
3822024-12-07T01:00:17.250ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3832024-12-07T01:00:17.251ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d6337ddb-eea5-4391-949a-f81d6b3f849e", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3842024-12-07T01:00:17.251ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3852024-12-07T01:00:17.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3862024-12-07T01:00:17.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3872024-12-07T01:00:17.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3882024-12-07T01:00:17.253ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6efbb373-9302-4d2c-855b-559bef294a70", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3892024-12-07T01:00:17.254ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3902024-12-07T01:00:17.255ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 52ba8747-d0f6-43d9-9ec0-995aa6df639a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3912024-12-07T01:00:17.255ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3922024-12-07T01:00:17.255ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-07 00:48:44.409012 UTC dns_group = internal generation = 1
3932024-12-07T01:00:17.255ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 489.723547ms iteration = 14 status = {"generation":1}
3942024-12-07T01:00:17.256ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3952024-12-07T01:00:17.256ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 491.204376ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3962024-12-07T01:00:17.274ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {ad42495b-040b-4b67-a0fa-9d16ddaed7a9: {10.151.2.176: {4f344fc7-2464-4c76-8b6a-425472f23c9f}, 10.151.2.175: {4f344fc7-2464-4c76-8b6a-425472f23c9f}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
3972024-12-07T01:00:17.274ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3982024-12-07T01:00:17.275ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8c48a101-7f5c-46b0-8169-670e60f3c2e1", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} })
3992024-12-07T01:00:17.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4002024-12-07T01:00:17.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4012024-12-07T01:00:17.276ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4022024-12-07T01:00:17.276ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 510.751212ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4032024-12-07T01:00:17.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a912cab9-4475-4fee-86ad-f2c94b65042b roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4042024-12-07T01:00:17.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a912cab9-4475-4fee-86ad-f2c94b65042b resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4052024-12-07T01:00:17.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4062024-12-07T01:00:17.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4072024-12-07T01:00:17.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a912cab9-4475-4fee-86ad-f2c94b65042b response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4082024-12-07T01:00:17.279ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-07T00:48:09.490271Z, time_modified: 2024-12-07T00:48:09.490271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 3a67a720-d4af-42e7-875a-3abed4955db5, db_silo: Silo { identity: SiloIdentity { id: 3a67a720-d4af-42e7-875a-3abed4955db5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-07T00:48:45.569718Z, time_modified: 2024-12-07T00:48:45.569718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6317ba4eb1538be6191eb18b3b3531d70dbee51545c790c2aff24b81494c24f4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 3a67a720-d4af-42e7-875a-3abed4955db5, db_silo: Silo { identity: SiloIdentity { id: 3a67a720-d4af-42e7-875a-3abed4955db5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-07T00:48:45.569718Z, time_modified: 2024-12-07T00:48:45.569718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6317ba4eb1538be6191eb18b3b3531d70dbee51545c790c2aff24b81494c24f4" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
4092024-12-07T01:00:17.279ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 514.147858ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"3a67a720-d4af-42e7-875a-3abed4955db5","tls_certs":["6317ba4eb1538be6191eb18b3b3531d70dbee51545c790c2aff24b81494c24f4"]}},"default_endpoint":{"silo_id":"3a67a720-d4af-42e7-875a-3abed4955db5","tls_certs":["6317ba4eb1538be6191eb18b3b3531d70dbee51545c790c2aff24b81494c24f4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4102024-12-07T01:00:17.279ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
4112024-12-07T01:00:17.279ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ae6d4ace-ffdd-4139-9e11-1794ae966042 dns_zone_name = oxide.test found_so_far = 0 version = 2
4122024-12-07T01:00:17.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4132024-12-07T01:00:17.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4142024-12-07T01:00:17.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4152024-12-07T01:00:17.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4162024-12-07T01:00:17.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4172024-12-07T01:00:17.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4182024-12-07T01:00:17.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4192024-12-07T01:00:17.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4202024-12-07T01:00:17.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4212024-12-07T01:00:17.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4222024-12-07T01:00:17.286ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ae6d4ace-ffdd-4139-9e11-1794ae966042 dns_zone_name = oxide.test found_so_far = 1 version = 2
4232024-12-07T01:00:17.286ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4242024-12-07T01:00:17.286ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-07 00:48:45.853224 UTC dns_group = external generation = 2
4252024-12-07T01:00:17.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 521.538344ms iteration = 14 status = {"generation":2}
4262024-12-07T01:00:17.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4272024-12-07T01:00:17.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4282024-12-07T01:00:17.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4292024-12-07T01:00:17.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4302024-12-07T01:00:17.295ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4312024-12-07T01:00:17.295ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4322024-12-07T01:00:17.295ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4332024-12-07T01:00:17.296ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1bb74ce7-2369-46f1-aba1-48c58f5943b1", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} })
4342024-12-07T01:00:17.297ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 531.526361ms iteration = 26 status = {}
4352024-12-07T01:00:17.315ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4362024-12-07T01:00:17.316ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1fb67b62-27f7-4a0c-89a6-dc22a0c13898", "date": "Sat, 07 Dec 2024 01:00:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4372024-12-07T01:00:17.316ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4382024-12-07T01:00:17.319ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "19eddf56-b423-47fb-a5dd-c8b5bb3f9b7f", "date": "Sat, 07 Dec 2024 01:00:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4392024-12-07T01:00:17.319ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4402024-12-07T01:00:17.319ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4412024-12-07T01:00:17.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4422024-12-07T01:00:17.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4432024-12-07T01:00:17.321ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e51769c0-8f91-479d-9dc6-301863e99ab9", "date": "Sat, 07 Dec 2024 01:00:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4442024-12-07T01:00:17.321ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4452024-12-07T01:00:17.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4462024-12-07T01:00:17.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4472024-12-07T01:00:17.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4482024-12-07T01:00:17.323ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4492024-12-07T01:00:17.323ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 557.912212ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4502024-12-07T01:00:17.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4512024-12-07T01:00:17.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4522024-12-07T01:00:17.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4532024-12-07T01:00:17.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4542024-12-07T01:00:17.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4552024-12-07T01:00:17.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4562024-12-07T01:00:17.367ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68b8f65f-54d5-4192-ac26-facf91340245, rack_id: 667e4910-296b-4cf9-a580-7c638e7aa45a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e642095a-6c9c-4557-b65a-98313f61cfeb) } rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0
4572024-12-07T01:00:17.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4582024-12-07T01:00:17.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4592024-12-07T01:00:17.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4602024-12-07T01:00:17.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "485758f5-68fd-4e6a-93ca-5513097f1201", "content-length": "134", "date": "Sat, 07 Dec 2024 01:00:17 GMT"} })
4612024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4622024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e642095a-6c9c-4557-b65a-98313f61cfeb
4632024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4642024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4652024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4662024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4672024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4682024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4692024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4702024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4712024-12-07T01:00:17.378ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
4722024-12-07T01:00:17.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4732024-12-07T01:00:17.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4742024-12-07T01:00:17.380ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4752024-12-07T01:00:17.380ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "74b35810-3160-44f7-98a3-ae48b6b512df", "content-length": "2", "date": "Sat, 07 Dec 2024 01:00:17 GMT"} })
4762024-12-07T01:00:17.380ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4772024-12-07T01:00:17.380ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6760d6ec-7e1c-4e15-92e5-3b6a94f4fdd9", "content-length": "52", "date": "Sat, 07 Dec 2024 01:00:17 GMT"} })
4782024-12-07T01:00:17.380ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0
4792024-12-07T01:00:17.380ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4802024-12-07T01:00:17.421ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4812024-12-07T01:00:17.474ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "31f2381e-56bd-447b-823f-287211a7ba9b", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} })
4822024-12-07T01:00:17.474ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch = Switch0
4832024-12-07T01:00:17.474ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4842024-12-07T01:00:17.475ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "afa9334d-55c6-44ff-a0c6-c16b8b656056", "content-length": "810", "date": "Sat, 07 Dec 2024 01:00:17 GMT"} })
4852024-12-07T01:00:17.475ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(1098235) }} sled = sock
4862024-12-07T01:00:17.475ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4872024-12-07T01:00:17.475ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
4882024-12-07T01:00:17.475ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "115c76fb-5c7f-43e2-aef3-92ce29e1f69b", "content-length": "682", "date": "Sat, 07 Dec 2024 01:00:16 GMT"} })
4892024-12-07T01:00:17.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4902024-12-07T01:00:17.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4912024-12-07T01:00:17.476ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 710.105693ms iteration = 25 status = {}
4922024-12-07T01:00:17.479ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4932024-12-07T01:00:17.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4942024-12-07T01:00:17.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4952024-12-07T01:00:17.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4962024-12-07T01:00:17.485ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4972024-12-07T01:00:17.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4982024-12-07T01:00:17.493ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 727.811801ms iteration = 25 status = {}
4992024-12-07T01:00:18.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2dadb35e-c1bc-4d65-a939-2c68d35a7f10 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5002024-12-07T01:00:18.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2dadb35e-c1bc-4d65-a939-2c68d35a7f10 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5012024-12-07T01:00:18.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2dadb35e-c1bc-4d65-a939-2c68d35a7f10 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5022024-12-07T01:00:19.166ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 remote_addr = [fd00:1122:3344:101::1]:58522 req_id = e2933f8c-ba3b-4f58-b01e-1615d2195f0c uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-07T01:00:19.166395898Z }
5032024-12-07T01:00:19.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = e2933f8c-ba3b-4f58-b01e-1615d2195f0c roles = RoleSet { roles: {} } uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5042024-12-07T01:00:19.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = e2933f8c-ba3b-4f58-b01e-1615d2195f0c resource = Database result = Ok(()) uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5052024-12-07T01:00:19.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35697 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = e2933f8c-ba3b-4f58-b01e-1615d2195f0c response_code = 204 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5062024-12-07T01:00:19.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8029ab4a-d48d-48bf-bf9d-45c0eb157833 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5072024-12-07T01:00:19.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8029ab4a-d48d-48bf-bf9d-45c0eb157833 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5082024-12-07T01:00:19.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8029ab4a-d48d-48bf-bf9d-45c0eb157833 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5092024-12-07T01:00:20.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ad874523-72a3-46ac-aa3c-7efd67b86fe5 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5102024-12-07T01:00:20.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ad874523-72a3-46ac-aa3c-7efd67b86fe5 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5112024-12-07T01:00:20.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ad874523-72a3-46ac-aa3c-7efd67b86fe5 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5122024-12-07T01:00:20.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 4b8a9853-4c3a-4198-b38b-378fe8f661ea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
5132024-12-07T01:00:20.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 4b8a9853-4c3a-4198-b38b-378fe8f661ea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
5142024-12-07T01:00:20.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 4b8a9853-4c3a-4198-b38b-378fe8f661ea response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
5152024-12-07T01:00:20.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 04494853-f1b4-4ae7-8673-31032ae4a81d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
5162024-12-07T01:00:20.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 04494853-f1b4-4ae7-8673-31032ae4a81d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
5172024-12-07T01:00:20.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 04494853-f1b4-4ae7-8673-31032ae4a81d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
5182024-12-07T01:00:21.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1cca2fda-537e-431e-99b9-220105bc7a24 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5192024-12-07T01:00:21.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1cca2fda-537e-431e-99b9-220105bc7a24 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5202024-12-07T01:00:21.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1cca2fda-537e-431e-99b9-220105bc7a24 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5212024-12-07T01:00:21.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 2963ad33-e2bd-4f05-9840-ec5cee64ef41 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
5222024-12-07T01:00:21.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 2963ad33-e2bd-4f05-9840-ec5cee64ef41 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
5232024-12-07T01:00:21.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 2963ad33-e2bd-4f05-9840-ec5cee64ef41 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
5242024-12-07T01:00:21.668ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-07T01:00:21.668024707Z }
5252024-12-07T01:00:21.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff roles = RoleSet { roles: {} } uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5262024-12-07T01:00:21.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff resource = Database result = Ok(()) uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5272024-12-07T01:00:21.677ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221 vmm_needs_update = true
5282024-12-07T01:00:21.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff roles = RoleSet { roles: {} } uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5292024-12-07T01:00:21.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff resource = Database result = Ok(()) uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5302024-12-07T01:00:21.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff roles = RoleSet { roles: {} } uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5312024-12-07T01:00:21.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff resource = Database result = Ok(()) uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5322024-12-07T01:00:21.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff roles = RoleSet { roles: {} } uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5332024-12-07T01:00:21.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff resource = Database result = Ok(()) uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5342024-12-07T01:00:21.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff roles = RoleSet { roles: {} } uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5352024-12-07T01:00:21.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff resource = Database result = Ok(()) uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5362024-12-07T01:00:21.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff roles = RoleSet { roles: {} } uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5372024-12-07T01:00:21.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff resource = Database result = Ok(()) uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5382024-12-07T01:00:21.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff roles = RoleSet { roles: {} } uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5392024-12-07T01:00:21.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff resource = Database result = Ok(()) uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5402024-12-07T01:00:21.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5412024-12-07T01:00:21.693ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 3a67a720-d4af-42e7-875a-3abed4955db5, lookup_type: ById(3a67a720-d4af-42e7-875a-3abed4955db5) }, key: 5f29c645-1da0-4c9a-9e97-85eb8bea9c4c, lookup_type: ById(5f29c645-1da0-4c9a-9e97-85eb8bea9c4c) }, key: d4e357bc-806f-4b64-837e-f3433fef287e, lookup_type: ById(d4e357bc-806f-4b64-837e-f3433fef287e) } result = Ok(()) uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5422024-12-07T01:00:21.693ZINFOnexus (dropshot_internal): starting update saga for d4e357bc-806f-4b64-837e-f3433fef287e actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-07T01:00:21.668024707Z }
5432024-12-07T01:00:21.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24939 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff response_code = 204 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5442024-12-07T01:00:21.693ZDEBGnexus (dropshot_internal): preparing instance-update saga for d4e357bc-806f-4b64-837e-f3433fef287e... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d4e357bc-806f-4b64-837e-f3433fef287e local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fd0aec0a-b8cf-4263-87f7-30881a41cbff uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5452024-12-07T01:00:21.693ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update
5462024-12-07T01:00:21.694ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8592a5b7-ec42-4d6d-a02b-80d96818ee91 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-07T01:00:21.668024707Z }
5472024-12-07T01:00:21.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8592a5b7-ec42-4d6d-a02b-80d96818ee91 roles = RoleSet { roles: {} } uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5482024-12-07T01:00:21.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8592a5b7-ec42-4d6d-a02b-80d96818ee91 resource = Database result = Ok(()) uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5492024-12-07T01:00:21.695ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"d4e357bc-806f-4b64-837e-f3433fef287e","lookup_type":{"ById":"d4e357bc-806f-4b64-837e-f3433fef287e"},"parent":{"key":"5f29c645-1da0-4c9a-9e97-85eb8bea9c4c","lookup_type":{"ById":"5f29c645-1da0-4c9a-9e97-85eb8bea9c4c"},"parent":{"key":"3a67a720-d4af-42e7-875a-3abed4955db5","lookup_type":{"ById":"3a67a720-d4af-42e7-875a-3abed4955db5"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
5502024-12-07T01:00:21.695ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update
5512024-12-07T01:00:21.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3163 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8592a5b7-ec42-4d6d-a02b-80d96818ee91 response_code = 204 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
5522024-12-07T01:00:21.726ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update
5532024-12-07T01:00:21.726ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
5542024-12-07T01:00:21.726ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
5552024-12-07T01:00:21.726ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
5562024-12-07T01:00:21.731ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
5572024-12-07T01:00:21.731ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
5582024-12-07T01:00:21.734ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
5592024-12-07T01:00:21.734ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
5602024-12-07T01:00:21.737ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
5612024-12-07T01:00:21.738ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f4b5d131-c391-46c5-801a-3c825d39384f")) node_id = 0 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
5622024-12-07T01:00:21.740ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
5632024-12-07T01:00:21.740ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
5642024-12-07T01:00:21.746ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update
5652024-12-07T01:00:21.746ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5662024-12-07T01:00:21.746ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5672024-12-07T01:00:21.748ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5682024-12-07T01:00:21.748ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5692024-12-07T01:00:21.750ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5702024-12-07T01:00:21.750ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5712024-12-07T01:00:21.752ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5722024-12-07T01:00:21.752ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5732024-12-07T01:00:21.753ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5742024-12-07T01:00:21.753ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5752024-12-07T01:00:21.755ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5762024-12-07T01:00:21.755ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5772024-12-07T01:00:21.756ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5782024-12-07T01:00:21.760ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 3a67a720-d4af-42e7-875a-3abed4955db5, lookup_type: ById(3a67a720-d4af-42e7-875a-3abed4955db5) }, key: 5f29c645-1da0-4c9a-9e97-85eb8bea9c4c, lookup_type: ById(5f29c645-1da0-4c9a-9e97-85eb8bea9c4c) }, key: d4e357bc-806f-4b64-837e-f3433fef287e, lookup_type: ById(d4e357bc-806f-4b64-837e-f3433fef287e) } result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5792024-12-07T01:00:21.760ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance updater_id = f4b5d131-c391-46c5-801a-3c825d39384f
5802024-12-07T01:00:21.760ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5812024-12-07T01:00:21.760ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5822024-12-07T01:00:21.769ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance updater_id = f4b5d131-c391-46c5-801a-3c825d39384f
5832024-12-07T01:00:21.769ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5842024-12-07T01:00:21.769ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance
5852024-12-07T01:00:21.773ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = d4e357bc-806f-4b64-837e-f3433fef287e locked_gen = Generation(Generation(2)) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = LockInstance updater_id = f4b5d131-c391-46c5-801a-3c825d39384f
5862024-12-07T01:00:21.775ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
5872024-12-07T01:00:21.775ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("f4b5d131-c391-46c5-801a-3c825d39384f")}) node_id = 1 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
5882024-12-07T01:00:21.778ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
5892024-12-07T01:00:21.778ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
5902024-12-07T01:00:21.782ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5912024-12-07T01:00:21.782ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5922024-12-07T01:00:21.786ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5932024-12-07T01:00:21.786ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5942024-12-07T01:00:21.787ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5952024-12-07T01:00:21.787ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5962024-12-07T01:00:21.788ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5972024-12-07T01:00:21.792ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 3a67a720-d4af-42e7-875a-3abed4955db5, lookup_type: ById(3a67a720-d4af-42e7-875a-3abed4955db5) }, key: 5f29c645-1da0-4c9a-9e97-85eb8bea9c4c, lookup_type: ById(5f29c645-1da0-4c9a-9e97-85eb8bea9c4c) }, key: d4e357bc-806f-4b64-837e-f3433fef287e, lookup_type: ById(d4e357bc-806f-4b64-837e-f3433fef287e) } result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5982024-12-07T01:00:21.792ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5992024-12-07T01:00:21.792ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6002024-12-07T01:00:21.800ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: cdff06af-548d-4d6e-8e27-5f181e4ed221, time_created: 2024-12-07T00:59:34.921695Z, time_deleted: None, instance_id: d4e357bc-806f-4b64-837e-f3433fef287e, sled_id: e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-07T01:00:21.668024Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-07T00:59:32.823938Z, gen: Generation(Generation(3)), propolis_id: Some(cdff06af-548d-4d6e-8e27-5f181e4ed221), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(cdff06af-548d-4d6e-8e27-5f181e4ed221 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-07T01:00:21.800492599Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
6012024-12-07T01:00:21.802ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6022024-12-07T01:00:21.802ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"d4e357bc-806f-4b64-837e-f3433fef287e","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"cdff06af-548d-4d6e-8e27-5f181e4ed221"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"d4e357bc-806f-4b64-837e-f3433fef287e","lookup_type":{"ById":"d4e357bc-806f-4b64-837e-f3433fef287e"},"parent":{"key":"5f29c645-1da0-4c9a-9e97-85eb8bea9c4c","lookup_type":{"ById":"5f29c645-1da0-4c9a-9e97-85eb8bea9c4c"},"parent":{"key":"3a67a720-d4af-42e7-875a-3abed4955db5","lookup_type":{"ById":"3a67a720-d4af-42e7-875a-3abed4955db5"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"f4b5d131-c391-46c5-801a-3c825d39384f"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"5f29c645-1da0-4c9a-9e97-85eb8bea9c4c","ram_diff":1073741824},"destroy_active_vmm":"cdff06af-548d-4d6e-8e27-5f181e4ed221","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-07T01:00:21.800492599Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6032024-12-07T01:00:21.802ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6042024-12-07T01:00:21.806ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6052024-12-07T01:00:21.806ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6062024-12-07T01:00:21.806ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6072024-12-07T01:00:21.806ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6082024-12-07T01:00:21.810ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6092024-12-07T01:00:21.810ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6102024-12-07T01:00:21.814ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6112024-12-07T01:00:21.814ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6122024-12-07T01:00:21.817ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6132024-12-07T01:00:21.817ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c8bd7767-6848-4e88-b532-ad5850dc4a5e")) node_id = 0 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6142024-12-07T01:00:21.820ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6152024-12-07T01:00:21.820ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6162024-12-07T01:00:21.828ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = d4e357bc-806f-4b64-837e-f3433fef287e parent_lock = UpdaterLock { updater_id: f4b5d131-c391-46c5-801a-3c825d39384f, locked_gen: Generation(Generation(2)) } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6172024-12-07T01:00:21.828ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = BecomeUpdater
6182024-12-07T01:00:21.828ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = BecomeUpdater
6192024-12-07T01:00:21.836ZDEBGnexus (SagaExecutor): inherited lock from f4b5d131-c391-46c5-801a-3c825d39384f to c8bd7767-6848-4e88-b532-ad5850dc4a5e actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d4e357bc-806f-4b64-837e-f3433fef287e locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = f4b5d131-c391-46c5-801a-3c825d39384f saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = BecomeUpdater updater_id = c8bd7767-6848-4e88-b532-ad5850dc4a5e
6202024-12-07T01:00:21.836ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6212024-12-07T01:00:21.836ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6222024-12-07T01:00:21.836ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c8bd7767-6848-4e88-b532-ad5850dc4a5e")}) node_id = 1 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6232024-12-07T01:00:21.839ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6242024-12-07T01:00:21.839ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6252024-12-07T01:00:21.842ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6262024-12-07T01:00:21.842ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6272024-12-07T01:00:21.845ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6282024-12-07T01:00:21.845ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6292024-12-07T01:00:21.849ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6302024-12-07T01:00:21.851ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e
6312024-12-07T01:00:21.853ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = UpdateNetworkConfig
6322024-12-07T01:00:21.853ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = UpdateNetworkConfig
6332024-12-07T01:00:21.857ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = UpdateNetworkConfig
6342024-12-07T01:00:21.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = UpdateNetworkConfig
6352024-12-07T01:00:21.859ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
6362024-12-07T01:00:21.859ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = UpdateNetworkConfig
6372024-12-07T01:00:21.859ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = UpdateNetworkConfig
6382024-12-07T01:00:21.862ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
6392024-12-07T01:00:21.862ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6402024-12-07T01:00:21.862ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6412024-12-07T01:00:21.863ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
6422024-12-07T01:00:21.865ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
6432024-12-07T01:00:21.865ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6442024-12-07T01:00:21.865ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6452024-12-07T01:00:21.869ZDEBGnexus: notifying dendrite of updates instance_id = Some(d4e357bc-806f-4b64-837e-f3433fef287e (instance)) switch = switch0
6462024-12-07T01:00:21.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4485, tv_nsec: 95457640 } })
6472024-12-07T01:00:21.870ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
6482024-12-07T01:00:21.901ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6492024-12-07T01:00:21.901ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6502024-12-07T01:00:21.901ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "238ad253-594c-46a9-8b6b-d8ce0bb112d5", "content-length": "26", "date": "Sat, 07 Dec 2024 01:00:21 GMT"} })
6512024-12-07T01:00:21.901ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6522024-12-07T01:00:21.902ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6532024-12-07T01:00:21.932ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
6542024-12-07T01:00:21.932ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "d71e6373-5bd9-4775-9cc3-baf5155c827a", "content-length": "4", "date": "Sat, 07 Dec 2024 01:00:21 GMT"} })
6552024-12-07T01:00:21.934ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6562024-12-07T01:00:21.934ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6572024-12-07T01:00:21.939ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6582024-12-07T01:00:21.939ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6592024-12-07T01:00:21.943ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
6602024-12-07T01:00:21.943ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
6612024-12-07T01:00:21.964ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-07T01:00:21.945991Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 3a67a720-d4af-42e7-875a-3abed4955db5, time_modified: Some(2024-12-07T01:00:21.945991Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 5f29c645-1da0-4c9a-9e97-85eb8bea9c4c, time_modified: Some(2024-12-07T01:00:21.945991Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6622024-12-07T01:00:21.964ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6632024-12-07T01:00:21.964ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6642024-12-07T01:00:21.967ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6652024-12-07T01:00:21.967ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6662024-12-07T01:00:21.970ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6672024-12-07T01:00:21.970ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = UnassignOximeterProducer
6682024-12-07T01:00:21.970ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = UnassignOximeterProducer
6692024-12-07T01:00:21.975ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 0c426bb3-2016-46d9-ae49-782d763f4e64 producer_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6702024-12-07T01:00:21.975ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = UnassignOximeterProducer
6712024-12-07T01:00:21.975ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = UnassignOximeterProducer
6722024-12-07T01:00:22.010ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6732024-12-07T01:00:22.013ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/d4e357bc-806f-4b64-837e-f3433fef287e
6742024-12-07T01:00:22.036ZDEBGnexus (SagaExecutor): client response oximeter-collector = d4e357bc-806f-4b64-837e-f3433fef287e result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/d4e357bc-806f-4b64-837e-f3433fef287e", status: 204, headers: {"x-request-id": "a20ac079-7051-4e8d-9d3c-5f5636d7b471", "date": "Sat, 07 Dec 2024 01:00:22 GMT"} }) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6752024-12-07T01:00:22.036ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 0c426bb3-2016-46d9-ae49-782d763f4e64 producer_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6762024-12-07T01:00:22.038ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6772024-12-07T01:00:22.038ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6782024-12-07T01:00:22.042ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6792024-12-07T01:00:22.042ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6802024-12-07T01:00:22.045ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = d4e357bc-806f-4b64-837e-f3433fef287e lock = UpdaterLock { updater_id: c8bd7767-6848-4e88-b532-ad5850dc4a5e, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-07T01:00:21.800492599Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6812024-12-07T01:00:22.045ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = CommitInstanceUpdates
6822024-12-07T01:00:22.045ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = CommitInstanceUpdates
6832024-12-07T01:00:22.092ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e new_runtime = InstanceRuntimeState { time_updated: 2024-12-07T01:00:21.800492599Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
6842024-12-07T01:00:22.092ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6852024-12-07T01:00:22.092ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6862024-12-07T01:00:22.092ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
6872024-12-07T01:00:22.092ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
6882024-12-07T01:00:22.092ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6892024-12-07T01:00:22.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6902024-12-07T01:00:22.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6912024-12-07T01:00:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6922024-12-07T01:00:22.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6932024-12-07T01:00:22.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6942024-12-07T01:00:22.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6952024-12-07T01:00:22.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6962024-12-07T01:00:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6972024-12-07T01:00:22.097ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
6982024-12-07T01:00:22.097ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
6992024-12-07T01:00:22.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7002024-12-07T01:00:22.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7012024-12-07T01:00:22.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7022024-12-07T01:00:22.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7032024-12-07T01:00:22.100ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7042024-12-07T01:00:22.100ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("d4e357bc-806f-4b64-837e-f3433fef287e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cdff06af-548d-4d6e-8e27-5f181e4ed221")}) node_id = 7 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7052024-12-07T01:00:22.104ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7062024-12-07T01:00:22.104ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7072024-12-07T01:00:22.107ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7082024-12-07T01:00:22.107ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7092024-12-07T01:00:22.112ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7102024-12-07T01:00:22.112ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7112024-12-07T01:00:22.119ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
7122024-12-07T01:00:22.119ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ReleaseSledResources
7132024-12-07T01:00:22.120ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ReleaseSledResources
7142024-12-07T01:00:22.137ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7152024-12-07T01:00:22.137ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7162024-12-07T01:00:22.138ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ffa4739-bd55-4a13-a01b-620f52f24d1c", "content-length": "372", "date": "Sat, 07 Dec 2024 01:00:22 GMT"} })
7172024-12-07T01:00:22.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7182024-12-07T01:00:22.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7192024-12-07T01:00:22.148ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7202024-12-07T01:00:22.148ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7212024-12-07T01:00:22.152ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7222024-12-07T01:00:22.152ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7232024-12-07T01:00:22.156ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
7242024-12-07T01:00:22.156ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = MarkVmmDeleted
7252024-12-07T01:00:22.156ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = MarkVmmDeleted
7262024-12-07T01:00:22.167ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7272024-12-07T01:00:22.167ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7282024-12-07T01:00:22.171ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7292024-12-07T01:00:22.171ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7302024-12-07T01:00:22.175ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7312024-12-07T01:00:22.175ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7322024-12-07T01:00:22.178ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7332024-12-07T01:00:22.178ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7342024-12-07T01:00:22.181ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ChainSuccessorSaga
7352024-12-07T01:00:22.181ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ChainSuccessorSaga
7362024-12-07T01:00:22.183ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ChainSuccessorSaga
7372024-12-07T01:00:22.183ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ChainSuccessorSaga
7382024-12-07T01:00:22.184ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ChainSuccessorSaga
7392024-12-07T01:00:22.184ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ChainSuccessorSaga
7402024-12-07T01:00:22.185ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ChainSuccessorSaga
7412024-12-07T01:00:22.188ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 3a67a720-d4af-42e7-875a-3abed4955db5, lookup_type: ById(3a67a720-d4af-42e7-875a-3abed4955db5) }, key: 5f29c645-1da0-4c9a-9e97-85eb8bea9c4c, lookup_type: ById(5f29c645-1da0-4c9a-9e97-85eb8bea9c4c) }, key: d4e357bc-806f-4b64-837e-f3433fef287e, lookup_type: ById(d4e357bc-806f-4b64-837e-f3433fef287e) } result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ChainSuccessorSaga
7422024-12-07T01:00:22.188ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ChainSuccessorSaga
7432024-12-07T01:00:22.189ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_node = ChainSuccessorSaga
7442024-12-07T01:00:22.190ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {ad42495b-040b-4b67-a0fa-9d16ddaed7a9: {10.151.2.176: {4f344fc7-2464-4c76-8b6a-425472f23c9f}, 10.151.2.175: {4f344fc7-2464-4c76-8b6a-425472f23c9f}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7452024-12-07T01:00:22.190ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7462024-12-07T01:00:22.190ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e911e5d1-87d5-4eaf-aef2-0cea2d22ee46", "date": "Sat, 07 Dec 2024 01:00:22 GMT"} })
7472024-12-07T01:00:22.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7482024-12-07T01:00:22.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7492024-12-07T01:00:22.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7502024-12-07T01:00:22.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7512024-12-07T01:00:22.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7522024-12-07T01:00:22.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7532024-12-07T01:00:22.197ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7542024-12-07T01:00:22.198ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7552024-12-07T01:00:22.198ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9f272839-cfe4-4015-936c-30e9950ea879", "date": "Sat, 07 Dec 2024 01:00:22 GMT"} })
7562024-12-07T01:00:22.199ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 107.056762ms iteration = 27 status = {}
7572024-12-07T01:00:22.223ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update
7582024-12-07T01:00:22.223ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7592024-12-07T01:00:22.223ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7602024-12-07T01:00:22.223ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
7612024-12-07T01:00:22.223ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
7622024-12-07T01:00:22.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7632024-12-07T01:00:22.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7642024-12-07T01:00:22.227ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7652024-12-07T01:00:22.227ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7662024-12-07T01:00:22.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7672024-12-07T01:00:22.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7682024-12-07T01:00:22.231ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7692024-12-07T01:00:22.231ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7702024-12-07T01:00:22.234ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7712024-12-07T01:00:22.234ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0
7722024-12-07T01:00:22.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7732024-12-07T01:00:22.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7742024-12-07T01:00:22.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7752024-12-07T01:00:22.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7762024-12-07T01:00:22.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7772024-12-07T01:00:22.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7782024-12-07T01:00:22.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7792024-12-07T01:00:22.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7802024-12-07T01:00:22.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7812024-12-07T01:00:22.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7822024-12-07T01:00:22.253ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7832024-12-07T01:00:22.253ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7842024-12-07T01:00:22.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7852024-12-07T01:00:22.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7862024-12-07T01:00:22.268ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7872024-12-07T01:00:22.268ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 saga_name = instance-update saga_result = SagaResult { saga_id: 65fd744b-32b0-4648-a1c1-a9770c876ba0, saga_log: SagaLog { saga_id: 65fd744b-32b0-4648-a1c1-a9770c876ba0, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("c8bd7767-6848-4e88-b532-ad5850dc4a5e")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c8bd7767-6848-4e88-b532-ad5850dc4a5e")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("d4e357bc-806f-4b64-837e-f3433fef287e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cdff06af-548d-4d6e-8e27-5f181e4ed221")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("d4e357bc-806f-4b64-837e-f3433fef287e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cdff06af-548d-4d6e-8e27-5f181e4ed221")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("c8bd7767-6848-4e88-b532-ad5850dc4a5e"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("c8bd7767-6848-4e88-b532-ad5850dc4a5e")}} }) }
7882024-12-07T01:00:22.268ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 65fd744b-32b0-4648-a1c1-a9770c876ba0 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update
7892024-12-07T01:00:22.269ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7902024-12-07T01:00:22.269ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
7912024-12-07T01:00:22.272ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7922024-12-07T01:00:22.272ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
7932024-12-07T01:00:22.276ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7942024-12-07T01:00:22.276ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
7952024-12-07T01:00:22.278ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7962024-12-07T01:00:22.278ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
7972024-12-07T01:00:22.278ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168
7982024-12-07T01:00:22.279ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4121618-4636-4e81-b0d4-aed8d5904764", "content-length": "691", "date": "Sat, 07 Dec 2024 01:00:22 GMT"} })
7992024-12-07T01:00:22.279ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8002024-12-07T01:00:22.279ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8012024-12-07T01:00:22.279ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8022024-12-07T01:00:22.281ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 188.65355ms iteration = 26 status = {}
8032024-12-07T01:00:22.281ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8042024-12-07T01:00:22.281ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8052024-12-07T01:00:22.281ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8062024-12-07T01:00:22.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8072024-12-07T01:00:22.309ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8082024-12-07T01:00:22.309ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8092024-12-07T01:00:22.309ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.310572ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8102024-12-07T01:00:22.324ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update sec_id = 00ea6ad0-de1a-4101-a100-38e35668045b
8112024-12-07T01:00:22.324ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b8f2cf99-f0b7-4f5c-a147-8519a887b168 saga_name = start-instance-update saga_result = SagaResult { saga_id: b8f2cf99-f0b7-4f5c-a147-8519a887b168, saga_log: SagaLog { saga_id: b8f2cf99-f0b7-4f5c-a147-8519a887b168, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("f4b5d131-c391-46c5-801a-3c825d39384f")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("f4b5d131-c391-46c5-801a-3c825d39384f")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("f4b5d131-c391-46c5-801a-3c825d39384f"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("f4b5d131-c391-46c5-801a-3c825d39384f")}} }) }
8122024-12-07T01:00:22.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 94f673ea-cb99-4013-a4b5-b8a19979135d roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8132024-12-07T01:00:22.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 94f673ea-cb99-4013-a4b5-b8a19979135d resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8142024-12-07T01:00:22.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 94f673ea-cb99-4013-a4b5-b8a19979135d response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8152024-12-07T01:00:22.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 9a15d198-5d1c-46e1-87c2-2205912d941e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
8162024-12-07T01:00:22.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 9a15d198-5d1c-46e1-87c2-2205912d941e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
8172024-12-07T01:00:22.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 9a15d198-5d1c-46e1-87c2-2205912d941e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
8182024-12-07T01:00:23.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 784fe1fa-d1ed-4596-aae8-e22190acd49e roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8192024-12-07T01:00:23.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 784fe1fa-d1ed-4596-aae8-e22190acd49e resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8202024-12-07T01:00:23.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 784fe1fa-d1ed-4596-aae8-e22190acd49e response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8212024-12-07T01:00:24.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6658dd1e-dbc4-42cf-8d62-5a6646d676d5 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8222024-12-07T01:00:24.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6658dd1e-dbc4-42cf-8d62-5a6646d676d5 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8232024-12-07T01:00:24.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6658dd1e-dbc4-42cf-8d62-5a6646d676d5 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8242024-12-07T01:00:25.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 61c0e11c-3039-4e94-9dfa-bfd345f3a51f roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8252024-12-07T01:00:25.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 61c0e11c-3039-4e94-9dfa-bfd345f3a51f resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8262024-12-07T01:00:25.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 61c0e11c-3039-4e94-9dfa-bfd345f3a51f response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8272024-12-07T01:00:26.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 5101f909-b806-4689-92c1-f26c56ca0c11 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8282024-12-07T01:00:26.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 5101f909-b806-4689-92c1-f26c56ca0c11 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8292024-12-07T01:00:26.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 5101f909-b806-4689-92c1-f26c56ca0c11 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8302024-12-07T01:00:26.765ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
8312024-12-07T01:00:26.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8322024-12-07T01:00:26.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8332024-12-07T01:00:26.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
8342024-12-07T01:00:26.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8352024-12-07T01:00:26.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8362024-12-07T01:00:26.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8372024-12-07T01:00:26.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8382024-12-07T01:00:26.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8392024-12-07T01:00:26.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8402024-12-07T01:00:26.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8412024-12-07T01:00:26.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8422024-12-07T01:00:26.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8432024-12-07T01:00:26.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8442024-12-07T01:00:26.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8452024-12-07T01:00:26.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
8462024-12-07T01:00:26.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8472024-12-07T01:00:26.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8482024-12-07T01:00:26.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
8492024-12-07T01:00:26.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.164846ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
8502024-12-07T01:00:26.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.848818ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8512024-12-07T01:00:27.185ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1455 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = 749bc02e-63a5-4097-93a3-f5b789fd423a response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
8522024-12-07T01:00:27.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = af20c606-c4b6-41a4-9552-14f8d75a2eb6 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8532024-12-07T01:00:27.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = af20c606-c4b6-41a4-9552-14f8d75a2eb6 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8542024-12-07T01:00:27.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = af20c606-c4b6-41a4-9552-14f8d75a2eb6 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8552024-12-07T01:00:28.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = c72acc77-be57-4e43-8e89-c68340ede1ee roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8562024-12-07T01:00:28.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = c72acc77-be57-4e43-8e89-c68340ede1ee resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8572024-12-07T01:00:28.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = c72acc77-be57-4e43-8e89-c68340ede1ee response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8582024-12-07T01:00:29.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = f82eca9b-0546-4c59-b905-5057434ac768 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8592024-12-07T01:00:29.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = f82eca9b-0546-4c59-b905-5057434ac768 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8602024-12-07T01:00:29.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = f82eca9b-0546-4c59-b905-5057434ac768 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8612024-12-07T01:00:30.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 245e185f-d1ee-4eb0-8291-f5f99fa0ad1b roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8622024-12-07T01:00:30.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 245e185f-d1ee-4eb0-8291-f5f99fa0ad1b resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8632024-12-07T01:00:30.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 245e185f-d1ee-4eb0-8291-f5f99fa0ad1b response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8642024-12-07T01:00:31.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9117c870-065a-4f27-9115-010bc0f30db9 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8652024-12-07T01:00:31.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9117c870-065a-4f27-9115-010bc0f30db9 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8662024-12-07T01:00:31.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9117c870-065a-4f27-9115-010bc0f30db9 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8672024-12-07T01:00:32.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 02b84ad8-0871-4990-aaa8-7e5190450414 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8682024-12-07T01:00:32.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 02b84ad8-0871-4990-aaa8-7e5190450414 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8692024-12-07T01:00:32.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 02b84ad8-0871-4990-aaa8-7e5190450414 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8702024-12-07T01:00:33.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9c09c5ff-6a09-4022-a14d-5783d67f1c95 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8712024-12-07T01:00:33.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9c09c5ff-6a09-4022-a14d-5783d67f1c95 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8722024-12-07T01:00:33.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9c09c5ff-6a09-4022-a14d-5783d67f1c95 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8732024-12-07T01:00:34.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 29ad5e8b-9e0c-4de6-b3de-14237590045f roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8742024-12-07T01:00:34.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 29ad5e8b-9e0c-4de6-b3de-14237590045f resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8752024-12-07T01:00:34.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 29ad5e8b-9e0c-4de6-b3de-14237590045f response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8762024-12-07T01:00:35.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9922eefe-dbbf-4e78-9f65-b9f5bb86e6a8 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8772024-12-07T01:00:35.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9922eefe-dbbf-4e78-9f65-b9f5bb86e6a8 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8782024-12-07T01:00:35.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9922eefe-dbbf-4e78-9f65-b9f5bb86e6a8 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8792024-12-07T01:00:36.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fbbb0fc5-4a55-4412-b915-c4ea202b0ed4 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8802024-12-07T01:00:36.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fbbb0fc5-4a55-4412-b915-c4ea202b0ed4 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8812024-12-07T01:00:36.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fbbb0fc5-4a55-4412-b915-c4ea202b0ed4 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8822024-12-07T01:00:36.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
8832024-12-07T01:00:36.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8842024-12-07T01:00:36.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8852024-12-07T01:00:36.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
8862024-12-07T01:00:36.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8872024-12-07T01:00:36.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8882024-12-07T01:00:36.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8892024-12-07T01:00:36.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8902024-12-07T01:00:36.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8912024-12-07T01:00:36.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8922024-12-07T01:00:36.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8932024-12-07T01:00:36.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8942024-12-07T01:00:36.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8952024-12-07T01:00:36.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8962024-12-07T01:00:36.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8972024-12-07T01:00:36.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
8982024-12-07T01:00:36.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8992024-12-07T01:00:36.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9002024-12-07T01:00:36.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
9012024-12-07T01:00:36.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.888882ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
9022024-12-07T01:00:36.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.287008ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9032024-12-07T01:00:37.185ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1549 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = c5df5aec-b051-463e-9bea-9e626abf9c75 response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
9042024-12-07T01:00:37.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9cfcd789-6619-45ad-8453-d146dbde21d5 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9052024-12-07T01:00:37.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9cfcd789-6619-45ad-8453-d146dbde21d5 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9062024-12-07T01:00:37.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9cfcd789-6619-45ad-8453-d146dbde21d5 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9072024-12-07T01:00:38.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 321b7748-0505-4d87-926d-4cd63e57337a roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9082024-12-07T01:00:38.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 321b7748-0505-4d87-926d-4cd63e57337a resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9092024-12-07T01:00:38.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 321b7748-0505-4d87-926d-4cd63e57337a response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9102024-12-07T01:00:39.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 564d456a-6800-4092-b512-a6c8caef0cd7 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9112024-12-07T01:00:39.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 564d456a-6800-4092-b512-a6c8caef0cd7 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9122024-12-07T01:00:39.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 564d456a-6800-4092-b512-a6c8caef0cd7 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9132024-12-07T01:00:40.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ff4d3916-0ac1-40d3-b66f-9b32f0bc4c61 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9142024-12-07T01:00:40.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ff4d3916-0ac1-40d3-b66f-9b32f0bc4c61 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9152024-12-07T01:00:40.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ff4d3916-0ac1-40d3-b66f-9b32f0bc4c61 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9162024-12-07T01:00:41.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9189f972-4ac9-4f73-b210-79d593dd1435 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9172024-12-07T01:00:41.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9189f972-4ac9-4f73-b210-79d593dd1435 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9182024-12-07T01:00:41.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9189f972-4ac9-4f73-b210-79d593dd1435 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9192024-12-07T01:00:42.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1c7d8162-c059-455e-9968-5e1106e78bee roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9202024-12-07T01:00:42.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1c7d8162-c059-455e-9968-5e1106e78bee resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9212024-12-07T01:00:42.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1c7d8162-c059-455e-9968-5e1106e78bee response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9222024-12-07T01:00:43.391ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:42080
9232024-12-07T01:00:43.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42080 req_id = c21d0415-8bef-4cb4-b020-1ad9014b6bd0 roles = RoleSet { roles: {} } uri = /metrics/producers
9242024-12-07T01:00:43.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42080 req_id = c21d0415-8bef-4cb4-b020-1ad9014b6bd0 resource = Database result = Ok(()) uri = /metrics/producers
9252024-12-07T01:00:43.425ZINFOnexus: assigned collector to new producer collector_id = 0c426bb3-2016-46d9-ae49-782d763f4e64 file = nexus/src/app/oximeter.rs:76 producer_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9262024-12-07T01:00:43.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33653 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42080 req_id = c21d0415-8bef-4cb4-b020-1ad9014b6bd0 response_code = 201 uri = /metrics/producers
9272024-12-07T01:00:43.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a2886d5a-e749-453d-bdd7-696c77bedf5f roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9282024-12-07T01:00:43.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a2886d5a-e749-453d-bdd7-696c77bedf5f resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9292024-12-07T01:00:43.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a2886d5a-e749-453d-bdd7-696c77bedf5f response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9302024-12-07T01:00:44.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3b0ebe91-df99-46b3-815b-bbb9397672ea roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9312024-12-07T01:00:44.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3b0ebe91-df99-46b3-815b-bbb9397672ea resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9322024-12-07T01:00:44.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3b0ebe91-df99-46b3-815b-bbb9397672ea response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9332024-12-07T01:00:45.121ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48163
9342024-12-07T01:00:45.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48163 req_id = b35c86f2-0d43-4ac2-bdc7-42eb70b78dd3 roles = RoleSet { roles: {} } uri = /metrics/producers
9352024-12-07T01:00:45.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48163 req_id = b35c86f2-0d43-4ac2-bdc7-42eb70b78dd3 resource = Database result = Ok(()) uri = /metrics/producers
9362024-12-07T01:00:45.154ZINFOnexus: assigned collector to new producer collector_id = 0c426bb3-2016-46d9-ae49-782d763f4e64 file = nexus/src/app/oximeter.rs:76 producer_id = 978012e6-ebb3-4e23-9a0c-4378450ce349
9372024-12-07T01:00:45.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33302 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48163 req_id = b35c86f2-0d43-4ac2-bdc7-42eb70b78dd3 response_code = 201 uri = /metrics/producers
9382024-12-07T01:00:45.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0f2ad047-f8df-4dd3-9a0b-3f997a833d58 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9392024-12-07T01:00:45.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0f2ad047-f8df-4dd3-9a0b-3f997a833d58 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9402024-12-07T01:00:45.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0f2ad047-f8df-4dd3-9a0b-3f997a833d58 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9412024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
9422024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
9432024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9442024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9452024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
9462024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
9472024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9482024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
9492024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9502024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9512024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9522024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9532024-12-07T01:00:46.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9542024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
9552024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
9562024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9572024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9582024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
9592024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9602024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
9612024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9622024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9632024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
9642024-12-07T01:00:46.766ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9652024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
9662024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9672024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9682024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
9692024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
9702024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9712024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9722024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
9732024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9742024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9752024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9762024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9772024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9782024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9792024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9802024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9812024-12-07T01:00:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9822024-12-07T01:00:46.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9832024-12-07T01:00:46.767ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
9842024-12-07T01:00:46.767ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
9852024-12-07T01:00:46.767ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
9862024-12-07T01:00:46.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9872024-12-07T01:00:46.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9882024-12-07T01:00:46.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9892024-12-07T01:00:46.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9902024-12-07T01:00:46.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9912024-12-07T01:00:46.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
9922024-12-07T01:00:46.768ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4509, tv_nsec: 993495739 } })
9932024-12-07T01:00:46.768ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
9942024-12-07T01:00:46.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9952024-12-07T01:00:46.768ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.54777ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9962024-12-07T01:00:46.768ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4509, tv_nsec: 994110982 } })
9972024-12-07T01:00:46.769ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
9982024-12-07T01:00:46.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9992024-12-07T01:00:46.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10002024-12-07T01:00:46.770ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10012024-12-07T01:00:46.771ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10022024-12-07T01:00:46.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10032024-12-07T01:00:46.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10042024-12-07T01:00:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10052024-12-07T01:00:46.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10062024-12-07T01:00:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10072024-12-07T01:00:46.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10082024-12-07T01:00:46.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10092024-12-07T01:00:46.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10102024-12-07T01:00:46.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10112024-12-07T01:00:46.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10122024-12-07T01:00:46.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10132024-12-07T01:00:46.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10142024-12-07T01:00:46.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10152024-12-07T01:00:46.777ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10162024-12-07T01:00:46.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10172024-12-07T01:00:46.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10182024-12-07T01:00:46.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10192024-12-07T01:00:46.779ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10202024-12-07T01:00:46.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10212024-12-07T01:00:46.779ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10222024-12-07T01:00:46.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10232024-12-07T01:00:46.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10242024-12-07T01:00:46.780ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10252024-12-07T01:00:46.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10262024-12-07T01:00:46.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10272024-12-07T01:00:46.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10282024-12-07T01:00:46.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10292024-12-07T01:00:46.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10302024-12-07T01:00:46.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10312024-12-07T01:00:46.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10322024-12-07T01:00:46.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.977945ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10332024-12-07T01:00:46.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10342024-12-07T01:00:46.784ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4510, tv_nsec: 9437774 } })
10352024-12-07T01:00:46.784ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
10362024-12-07T01:00:46.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10372024-12-07T01:00:46.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10382024-12-07T01:00:46.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10392024-12-07T01:00:46.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10402024-12-07T01:00:46.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10412024-12-07T01:00:46.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10422024-12-07T01:00:46.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10432024-12-07T01:00:46.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.03211ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
10442024-12-07T01:00:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10452024-12-07T01:00:46.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10462024-12-07T01:00:46.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10472024-12-07T01:00:46.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.413836ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
10482024-12-07T01:00:46.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10492024-12-07T01:00:46.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10502024-12-07T01:00:46.816ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10512024-12-07T01:00:46.816ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10522024-12-07T01:00:46.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10532024-12-07T01:00:46.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10542024-12-07T01:00:46.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10552024-12-07T01:00:46.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10562024-12-07T01:00:46.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10572024-12-07T01:00:46.820ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10582024-12-07T01:00:46.820ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 54.122567ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
10592024-12-07T01:00:46.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
10602024-12-07T01:00:46.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10612024-12-07T01:00:46.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10622024-12-07T01:00:46.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10632024-12-07T01:00:46.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10642024-12-07T01:00:46.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10652024-12-07T01:00:46.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10662024-12-07T01:00:46.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10672024-12-07T01:00:46.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10682024-12-07T01:00:46.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
10692024-12-07T01:00:46.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.291894ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
10702024-12-07T01:00:46.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.237892ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10712024-12-07T01:00:46.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10722024-12-07T01:00:46.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 82.416325ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10732024-12-07T01:00:46.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.575858ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10742024-12-07T01:00:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3, lookup_type: ById(e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) } result = Ok(())
10752024-12-07T01:00:46.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10762024-12-07T01:00:46.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10772024-12-07T01:00:46.858ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10782024-12-07T01:00:46.858ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10792024-12-07T01:00:46.858ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10802024-12-07T01:00:46.858ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10812024-12-07T01:00:46.858ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.007494ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10822024-12-07T01:00:46.858ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "390e3503-00ba-4571-8738-a757f4fe0f68", "content-length": "26", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
10832024-12-07T01:00:46.858ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10842024-12-07T01:00:46.860ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10852024-12-07T01:00:46.864ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10862024-12-07T01:00:46.864ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10872024-12-07T01:00:46.865ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5ddb3ad-bea4-4ba6-aaf0-002f52836cec", "content-length": "26", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
10882024-12-07T01:00:46.865ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10892024-12-07T01:00:46.867ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10902024-12-07T01:00:46.882ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a zone_address = fd00:1122:3344:101::2
10912024-12-07T01:00:46.882ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10922024-12-07T01:00:46.883ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "61bb2c80-177e-4d67-9796-05423aa5f5fd", "content-length": "26", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
10932024-12-07T01:00:46.883ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10942024-12-07T01:00:46.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10952024-12-07T01:00:46.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10962024-12-07T01:00:46.885ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
10972024-12-07T01:00:46.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 68dfbe6c-484f-493a-ab3a-1ab01201f8d9 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
10982024-12-07T01:00:46.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 68dfbe6c-484f-493a-ab3a-1ab01201f8d9 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
10992024-12-07T01:00:46.918ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.270773ms iteration = 30 status = {"physical_disks_added":0}
11002024-12-07T01:00:46.983ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11012024-12-07T01:00:46.983ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1a451d9-3c6b-4ed9-8de1-a4b372f7e8d2", "content-length": "2", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
11022024-12-07T01:00:46.984ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11032024-12-07T01:00:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11042024-12-07T01:00:46.998ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11052024-12-07T01:00:46.998ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11062024-12-07T01:00:46.998ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "436f7066-adbc-4e18-9daf-f7f01fa8e97c", "content-length": "372", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
11072024-12-07T01:00:46.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11082024-12-07T01:00:46.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11092024-12-07T01:00:47.000ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 234.043395ms iteration = 26 status = 0
11102024-12-07T01:00:47.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 68dfbe6c-484f-493a-ab3a-1ab01201f8d9 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
11112024-12-07T01:00:47.002ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 236.766688ms iteration = 26 status = null
11122024-12-07T01:00:47.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11132024-12-07T01:00:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11142024-12-07T01:00:47.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11152024-12-07T01:00:47.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11162024-12-07T01:00:47.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11172024-12-07T01:00:47.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11182024-12-07T01:00:47.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11192024-12-07T01:00:47.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11202024-12-07T01:00:47.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11212024-12-07T01:00:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11222024-12-07T01:00:47.014ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11232024-12-07T01:00:47.014ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11242024-12-07T01:00:47.015ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "817fbaf9-277f-49b6-851a-cfa35ecdc05f", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
11252024-12-07T01:00:47.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11262024-12-07T01:00:47.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11272024-12-07T01:00:47.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11282024-12-07T01:00:47.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11292024-12-07T01:00:47.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11302024-12-07T01:00:47.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11312024-12-07T01:00:47.022ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11322024-12-07T01:00:47.022ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11332024-12-07T01:00:47.023ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a6fe54f2-21e3-4ea1-8be3-856b7b4d50de", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
11342024-12-07T01:00:47.024ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 257.931666ms iteration = 28 status = {}
11352024-12-07T01:00:47.030ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 264.74591ms iteration = 26 status = {}
11362024-12-07T01:00:47.081ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11372024-12-07T01:00:47.082ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "694c91ad-b6f8-445b-bac2-b65a13cc3cfd", "content-length": "691", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
11382024-12-07T01:00:47.082ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11392024-12-07T01:00:47.082ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11402024-12-07T01:00:47.082ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11412024-12-07T01:00:47.084ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 317.653514ms iteration = 27 status = {}
11422024-12-07T01:00:47.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11432024-12-07T01:00:47.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11442024-12-07T01:00:47.108ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68b8f65f-54d5-4192-ac26-facf91340245, rack_id: 667e4910-296b-4cf9-a580-7c638e7aa45a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e642095a-6c9c-4557-b65a-98313f61cfeb) } rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0
11452024-12-07T01:00:47.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11462024-12-07T01:00:47.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11472024-12-07T01:00:47.118ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11482024-12-07T01:00:47.119ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cba9a33b-187b-43b2-9ee2-0f441650cf8d", "content-length": "134", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
11492024-12-07T01:00:47.119ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11502024-12-07T01:00:47.119ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e642095a-6c9c-4557-b65a-98313f61cfeb
11512024-12-07T01:00:47.119ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11522024-12-07T01:00:47.119ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11532024-12-07T01:00:47.119ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11542024-12-07T01:00:47.119ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11552024-12-07T01:00:47.119ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11562024-12-07T01:00:47.119ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11572024-12-07T01:00:47.119ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11582024-12-07T01:00:47.119ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11592024-12-07T01:00:47.120ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
11602024-12-07T01:00:47.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11612024-12-07T01:00:47.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11622024-12-07T01:00:47.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11632024-12-07T01:00:47.122ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "39674a52-2cee-456c-8c19-e822453374a9", "content-length": "2", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
11642024-12-07T01:00:47.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11652024-12-07T01:00:47.122ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cd6c3f2-947f-4741-8dc3-33860d6bde93", "content-length": "52", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
11662024-12-07T01:00:47.122ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0
11672024-12-07T01:00:47.122ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11682024-12-07T01:00:47.185ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = 690a1482-a356-4885-9007-a194ddb40f00 response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
11692024-12-07T01:00:47.190ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:46871
11702024-12-07T01:00:47.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46871 req_id = da310ba8-855f-47d2-bcc0-388f1b79582b roles = RoleSet { roles: {} } uri = /metrics/producers
11712024-12-07T01:00:47.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46871 req_id = da310ba8-855f-47d2-bcc0-388f1b79582b resource = Database result = Ok(()) uri = /metrics/producers
11722024-12-07T01:00:47.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7d3f5ef2-9469-4ef1-8f8c-2590de917208", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
11732024-12-07T01:00:47.248ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch = Switch0
11742024-12-07T01:00:47.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11752024-12-07T01:00:47.248ZINFOnexus: assigned collector to new producer collector_id = 0c426bb3-2016-46d9-ae49-782d763f4e64 file = nexus/src/app/oximeter.rs:76 producer_id = 64d32e26-93d5-4a7e-b31f-1db18ea0b772
11762024-12-07T01:00:47.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57491 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46871 req_id = da310ba8-855f-47d2-bcc0-388f1b79582b response_code = 201 uri = /metrics/producers
11772024-12-07T01:00:47.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "047e36f1-40ba-4c27-a0b9-8e52a71dca36", "content-length": "682", "date": "Sat, 07 Dec 2024 01:00:46 GMT"} })
11782024-12-07T01:00:47.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11792024-12-07T01:00:47.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11802024-12-07T01:00:47.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11812024-12-07T01:00:47.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11822024-12-07T01:00:47.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11832024-12-07T01:00:47.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11842024-12-07T01:00:47.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11852024-12-07T01:00:47.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11862024-12-07T01:00:47.267ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 500.504409ms iteration = 26 status = {}
11872024-12-07T01:00:48.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a2130ce9-1eac-4290-9d43-cb1802b1a321 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
11882024-12-07T01:00:48.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a2130ce9-1eac-4290-9d43-cb1802b1a321 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
11892024-12-07T01:00:48.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a2130ce9-1eac-4290-9d43-cb1802b1a321 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
11902024-12-07T01:00:48.719ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:56676
11912024-12-07T01:00:48.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56676 req_id = 7a0fca86-fba5-44b5-83bd-b1ba378938bb roles = RoleSet { roles: {} } uri = /metrics/producers
11922024-12-07T01:00:48.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56676 req_id = 7a0fca86-fba5-44b5-83bd-b1ba378938bb resource = Database result = Ok(()) uri = /metrics/producers
11932024-12-07T01:00:48.758ZINFOnexus: assigned collector to new producer collector_id = 0c426bb3-2016-46d9-ae49-782d763f4e64 file = nexus/src/app/oximeter.rs:76 producer_id = 630ff20a-bc24-4456-8b29-6fa2f4364e40
11942024-12-07T01:00:48.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38264 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56676 req_id = 7a0fca86-fba5-44b5-83bd-b1ba378938bb response_code = 201 uri = /metrics/producers
11952024-12-07T01:00:49.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9be8daa1-ef9f-4865-83f0-248cc3b7e595 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
11962024-12-07T01:00:49.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9be8daa1-ef9f-4865-83f0-248cc3b7e595 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
11972024-12-07T01:00:49.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9be8daa1-ef9f-4865-83f0-248cc3b7e595 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
11982024-12-07T01:00:50.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6c87519a-6759-4106-8300-0b59cef21866 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
11992024-12-07T01:00:50.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6c87519a-6759-4106-8300-0b59cef21866 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12002024-12-07T01:00:50.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6c87519a-6759-4106-8300-0b59cef21866 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12012024-12-07T01:00:51.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0a0f6e69-a683-41db-91d0-9fcbf4e9d1ea roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12022024-12-07T01:00:51.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0a0f6e69-a683-41db-91d0-9fcbf4e9d1ea resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12032024-12-07T01:00:51.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0a0f6e69-a683-41db-91d0-9fcbf4e9d1ea response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12042024-12-07T01:00:52.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 52913ac1-4b60-4bad-891f-613f0c3dbd93 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12052024-12-07T01:00:52.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 52913ac1-4b60-4bad-891f-613f0c3dbd93 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12062024-12-07T01:00:52.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 52913ac1-4b60-4bad-891f-613f0c3dbd93 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12072024-12-07T01:00:52.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 4693cdf4-54ce-4469-a380-813864f30e6f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
12082024-12-07T01:00:52.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 4693cdf4-54ce-4469-a380-813864f30e6f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
12092024-12-07T01:00:52.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 4693cdf4-54ce-4469-a380-813864f30e6f response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
12102024-12-07T01:00:53.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ad8aefdb-7192-4202-a632-52ef5c505ad8 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12112024-12-07T01:00:53.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ad8aefdb-7192-4202-a632-52ef5c505ad8 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12122024-12-07T01:00:53.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ad8aefdb-7192-4202-a632-52ef5c505ad8 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12132024-12-07T01:00:54.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 94c74668-321e-46f3-aced-96753896a8f6 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12142024-12-07T01:00:54.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 94c74668-321e-46f3-aced-96753896a8f6 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12152024-12-07T01:00:54.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 94c74668-321e-46f3-aced-96753896a8f6 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12162024-12-07T01:00:55.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fc2bc08a-ec84-411b-acd7-eefd01251955 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12172024-12-07T01:00:55.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fc2bc08a-ec84-411b-acd7-eefd01251955 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12182024-12-07T01:00:55.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = fc2bc08a-ec84-411b-acd7-eefd01251955 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12192024-12-07T01:00:56.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 86832a6c-3251-4401-bb99-4ad9fd502ac6 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12202024-12-07T01:00:56.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 86832a6c-3251-4401-bb99-4ad9fd502ac6 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12212024-12-07T01:00:56.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 86832a6c-3251-4401-bb99-4ad9fd502ac6 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12222024-12-07T01:00:56.765ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
12232024-12-07T01:00:56.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12242024-12-07T01:00:56.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12252024-12-07T01:00:56.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
12262024-12-07T01:00:56.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12272024-12-07T01:00:56.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12282024-12-07T01:00:56.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12292024-12-07T01:00:56.768ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12302024-12-07T01:00:56.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12312024-12-07T01:00:56.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.308215ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12322024-12-07T01:00:56.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12332024-12-07T01:00:56.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12342024-12-07T01:00:56.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12352024-12-07T01:00:56.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12362024-12-07T01:00:56.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12372024-12-07T01:00:56.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12382024-12-07T01:00:56.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
12392024-12-07T01:00:56.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12402024-12-07T01:00:56.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12412024-12-07T01:00:56.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
12422024-12-07T01:00:56.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.988014ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
12432024-12-07T01:00:57.064ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:46807
12442024-12-07T01:00:57.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46807 req_id = 9494975f-1cb5-43ad-88ea-c3bbe5c4807a roles = RoleSet { roles: {} } uri = /metrics/producers
12452024-12-07T01:00:57.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46807 req_id = 9494975f-1cb5-43ad-88ea-c3bbe5c4807a resource = Database result = Ok(()) uri = /metrics/producers
12462024-12-07T01:00:57.074ZINFOnexus: assigned collector to new producer collector_id = 0c426bb3-2016-46d9-ae49-782d763f4e64 file = nexus/src/app/oximeter.rs:76 producer_id = 93fcc486-f79d-4924-ac29-22221c18d38a
12472024-12-07T01:00:57.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9773 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46807 req_id = 9494975f-1cb5-43ad-88ea-c3bbe5c4807a response_code = 201 uri = /metrics/producers
12482024-12-07T01:00:57.185ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = 105856a9-809e-4c4e-b2dd-a2350a07fab0 response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
12492024-12-07T01:00:57.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3189fa9e-56bd-4874-b5a1-ede1a5cd2695 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12502024-12-07T01:00:57.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3189fa9e-56bd-4874-b5a1-ede1a5cd2695 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12512024-12-07T01:00:57.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3189fa9e-56bd-4874-b5a1-ede1a5cd2695 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12522024-12-07T01:00:57.969ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:37025
12532024-12-07T01:00:57.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37025 req_id = 8dd9248e-3a29-4e10-bef1-4149d89be816 roles = RoleSet { roles: {} } uri = /metrics/producers
12542024-12-07T01:00:57.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37025 req_id = 8dd9248e-3a29-4e10-bef1-4149d89be816 resource = Database result = Ok(()) uri = /metrics/producers
12552024-12-07T01:00:57.981ZINFOnexus: assigned collector to new producer collector_id = 0c426bb3-2016-46d9-ae49-782d763f4e64 file = nexus/src/app/oximeter.rs:76 producer_id = ec230335-d958-42f7-985d-8c85e89beee7
12562024-12-07T01:00:57.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12642 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37025 req_id = 8dd9248e-3a29-4e10-bef1-4149d89be816 response_code = 201 uri = /metrics/producers
12572024-12-07T01:00:58.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 4167a2a5-069b-4b95-a36e-daa16170f772 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12582024-12-07T01:00:58.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 4167a2a5-069b-4b95-a36e-daa16170f772 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12592024-12-07T01:00:58.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 4167a2a5-069b-4b95-a36e-daa16170f772 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12602024-12-07T01:00:59.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1058ba86-ddf2-436e-8e15-0f79effce563 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12612024-12-07T01:00:59.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1058ba86-ddf2-436e-8e15-0f79effce563 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12622024-12-07T01:00:59.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 1058ba86-ddf2-436e-8e15-0f79effce563 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12632024-12-07T01:01:00.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3ee051f4-8778-4496-a3be-864d64c87b1f roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12642024-12-07T01:01:00.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3ee051f4-8778-4496-a3be-864d64c87b1f resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12652024-12-07T01:01:00.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3ee051f4-8778-4496-a3be-864d64c87b1f response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12662024-12-07T01:01:01.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2a500f6c-2910-4bb9-8645-b5cd0515dd04 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12672024-12-07T01:01:01.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2a500f6c-2910-4bb9-8645-b5cd0515dd04 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12682024-12-07T01:01:01.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2a500f6c-2910-4bb9-8645-b5cd0515dd04 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12692024-12-07T01:01:02.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = abf1a356-8092-4c3f-97cb-9372179e39c7 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12702024-12-07T01:01:02.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = abf1a356-8092-4c3f-97cb-9372179e39c7 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12712024-12-07T01:01:02.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = abf1a356-8092-4c3f-97cb-9372179e39c7 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12722024-12-07T01:01:03.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a4d75fd7-ce5a-4c05-90c8-02858da9daf0 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12732024-12-07T01:01:03.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a4d75fd7-ce5a-4c05-90c8-02858da9daf0 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12742024-12-07T01:01:03.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a4d75fd7-ce5a-4c05-90c8-02858da9daf0 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12752024-12-07T01:01:04.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = cf85ac30-a6cf-4f76-bfe9-c7a1aea96694 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12762024-12-07T01:01:04.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = cf85ac30-a6cf-4f76-bfe9-c7a1aea96694 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12772024-12-07T01:01:04.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = cf85ac30-a6cf-4f76-bfe9-c7a1aea96694 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12782024-12-07T01:01:05.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = bdede91b-3de1-4a88-bb62-e22c41b3d98d roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12792024-12-07T01:01:05.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = bdede91b-3de1-4a88-bb62-e22c41b3d98d resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12802024-12-07T01:01:05.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = bdede91b-3de1-4a88-bb62-e22c41b3d98d response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12812024-12-07T01:01:06.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 62aabe55-6740-4bc3-99a6-081bb44c4456 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12822024-12-07T01:01:06.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 62aabe55-6740-4bc3-99a6-081bb44c4456 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12832024-12-07T01:01:06.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 62aabe55-6740-4bc3-99a6-081bb44c4456 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12842024-12-07T01:01:06.765ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
12852024-12-07T01:01:06.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12862024-12-07T01:01:06.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12872024-12-07T01:01:06.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
12882024-12-07T01:01:06.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12892024-12-07T01:01:06.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12902024-12-07T01:01:06.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12912024-12-07T01:01:06.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12922024-12-07T01:01:06.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12932024-12-07T01:01:06.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12942024-12-07T01:01:06.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12952024-12-07T01:01:06.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12962024-12-07T01:01:06.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12972024-12-07T01:01:06.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
12982024-12-07T01:01:06.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12992024-12-07T01:01:06.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13002024-12-07T01:01:06.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
13012024-12-07T01:01:06.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.975723ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
13022024-12-07T01:01:06.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13032024-12-07T01:01:06.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13042024-12-07T01:01:06.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.113513ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13052024-12-07T01:01:07.185ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1397 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = 4023f50c-2404-41d5-8f0c-2b5e2b3380db response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
13062024-12-07T01:01:07.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 51a27500-0088-45d9-a22a-f1c9cb67c2b3 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13072024-12-07T01:01:07.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 51a27500-0088-45d9-a22a-f1c9cb67c2b3 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13082024-12-07T01:01:07.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 51a27500-0088-45d9-a22a-f1c9cb67c2b3 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13092024-12-07T01:01:08.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ce69b7f3-ae51-42a7-87eb-b87dca5b0ac4 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13102024-12-07T01:01:08.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ce69b7f3-ae51-42a7-87eb-b87dca5b0ac4 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13112024-12-07T01:01:08.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ce69b7f3-ae51-42a7-87eb-b87dca5b0ac4 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13122024-12-07T01:01:09.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6d11f0fc-b1e3-4eb5-b1b8-be6dc9bc32fd roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13132024-12-07T01:01:09.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6d11f0fc-b1e3-4eb5-b1b8-be6dc9bc32fd resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13142024-12-07T01:01:09.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6d11f0fc-b1e3-4eb5-b1b8-be6dc9bc32fd response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13152024-12-07T01:01:10.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8cf594bf-f427-4e18-b17b-d7da394dd0fc roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13162024-12-07T01:01:10.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8cf594bf-f427-4e18-b17b-d7da394dd0fc resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13172024-12-07T01:01:10.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8cf594bf-f427-4e18-b17b-d7da394dd0fc response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13182024-12-07T01:01:11.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2dcde65a-ebe9-4a22-84c5-3b18d050e877 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13192024-12-07T01:01:11.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2dcde65a-ebe9-4a22-84c5-3b18d050e877 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13202024-12-07T01:01:11.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2dcde65a-ebe9-4a22-84c5-3b18d050e877 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13212024-12-07T01:01:12.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 59e4560c-bdb7-4d55-9f49-61c8d04661da roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13222024-12-07T01:01:12.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 59e4560c-bdb7-4d55-9f49-61c8d04661da resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13232024-12-07T01:01:12.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 59e4560c-bdb7-4d55-9f49-61c8d04661da response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13242024-12-07T01:01:13.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ede81d2d-ab38-4a6c-b851-b97b31a06721 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13252024-12-07T01:01:13.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ede81d2d-ab38-4a6c-b851-b97b31a06721 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13262024-12-07T01:01:13.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ede81d2d-ab38-4a6c-b851-b97b31a06721 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13272024-12-07T01:01:14.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = b9746c8b-f840-4514-b7c4-1413fbd3e8b5 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13282024-12-07T01:01:14.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = b9746c8b-f840-4514-b7c4-1413fbd3e8b5 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13292024-12-07T01:01:14.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = b9746c8b-f840-4514-b7c4-1413fbd3e8b5 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13302024-12-07T01:01:15.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 4ff8a047-ed85-447b-ab81-f3b18fdd86f0 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13312024-12-07T01:01:15.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 4ff8a047-ed85-447b-ab81-f3b18fdd86f0 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13322024-12-07T01:01:15.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 4ff8a047-ed85-447b-ab81-f3b18fdd86f0 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13332024-12-07T01:01:16.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ed0c0d1e-bee9-4d34-81e0-b6141334ca60 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13342024-12-07T01:01:16.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ed0c0d1e-bee9-4d34-81e0-b6141334ca60 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13352024-12-07T01:01:16.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = ed0c0d1e-bee9-4d34-81e0-b6141334ca60 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
13362024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
13372024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13382024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
13392024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
13402024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
13412024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
13422024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
13432024-12-07T01:01:16.765ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13442024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
13452024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13462024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13472024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13482024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
13492024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13502024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13512024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
13522024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
13532024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13542024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13552024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
13562024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13572024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
13582024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13592024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
13602024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
13612024-12-07T01:01:16.765ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-07 00:51:16.765681919 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13622024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13632024-12-07T01:01:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13642024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13652024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13662024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13672024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
13682024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
13692024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13702024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13712024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
13722024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13732024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13742024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
13752024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
13762024-12-07T01:01:16.766ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70
13772024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13782024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
13792024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.79\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70"}
13802024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13812024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
13822024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
13832024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13842024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13852024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13862024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13872024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
13882024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
13892024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
13902024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13912024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13922024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13932024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13942024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
13952024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13962024-12-07T01:01:16.766ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13972024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13982024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
13992024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14002024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14012024-12-07T01:01:16.766ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eda26d3e-18ec-4c21-8ff4-73abfd373bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fe4d45f4-708c-423b-9b9c-06a074a360b5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fe4d45f4-708c-423b-9b9c-06a074a360b5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4539, tv_nsec: 991489835 } })
14022024-12-07T01:01:16.766ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5661fac0-67b8-45f8-869a-67dd3e21bd0b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be11a55e-cb67-4535-ad44-b9a4d4586728.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fd72061d-6779-40de-8011-8e899981c9e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fd72061d-6779-40de-8011-8e899981c9e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 4539, tv_nsec: 991504485 } })
14032024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14042024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14052024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14062024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14072024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14082024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14092024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14102024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14112024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14122024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14132024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14142024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14152024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
14162024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.276905ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
14172024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
14182024-12-07T01:01:16.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.338436ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
14192024-12-07T01:01:16.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14202024-12-07T01:01:16.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14212024-12-07T01:01:16.767ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
14222024-12-07T01:01:16.767ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
14232024-12-07T01:01:16.767ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
14242024-12-07T01:01:16.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14252024-12-07T01:01:16.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14262024-12-07T01:01:16.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14272024-12-07T01:01:16.768ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4539, tv_nsec: 993234739 } })
14282024-12-07T01:01:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14292024-12-07T01:01:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14302024-12-07T01:01:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14312024-12-07T01:01:16.768ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14322024-12-07T01:01:16.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14332024-12-07T01:01:16.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14342024-12-07T01:01:16.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14352024-12-07T01:01:16.769ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14362024-12-07T01:01:16.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372024-12-07T01:01:16.769ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.144102ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14382024-12-07T01:01:16.770ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-07 00:51:16.765681919 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14392024-12-07T01:01:16.770ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.889697ms iteration = 14 status = {"expiration":"2024-12-07T00:51:16.765681919Z","pruned":[]}
14402024-12-07T01:01:16.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14412024-12-07T01:01:16.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14422024-12-07T01:01:16.772ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14432024-12-07T01:01:16.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14442024-12-07T01:01:16.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14452024-12-07T01:01:16.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14462024-12-07T01:01:16.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14472024-12-07T01:01:16.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14482024-12-07T01:01:16.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14492024-12-07T01:01:16.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14502024-12-07T01:01:16.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14512024-12-07T01:01:16.775ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4540, tv_nsec: 975662 } })
14522024-12-07T01:01:16.776ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14532024-12-07T01:01:16.776ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.526797ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
14542024-12-07T01:01:16.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14552024-12-07T01:01:16.777ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14562024-12-07T01:01:16.777ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14572024-12-07T01:01:16.777ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14582024-12-07T01:01:16.777ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14592024-12-07T01:01:16.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14602024-12-07T01:01:16.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14612024-12-07T01:01:16.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14622024-12-07T01:01:16.777ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14632024-12-07T01:01:16.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14642024-12-07T01:01:16.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14652024-12-07T01:01:16.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14662024-12-07T01:01:16.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14672024-12-07T01:01:16.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14682024-12-07T01:01:16.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14692024-12-07T01:01:16.783ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702024-12-07T01:01:16.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14712024-12-07T01:01:16.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14722024-12-07T01:01:16.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14732024-12-07T01:01:16.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14742024-12-07T01:01:16.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14752024-12-07T01:01:16.787ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14762024-12-07T01:01:16.787ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14772024-12-07T01:01:16.787ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.397892ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14782024-12-07T01:01:16.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14792024-12-07T01:01:16.789ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 21.194208ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
14802024-12-07T01:01:16.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14812024-12-07T01:01:16.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14822024-12-07T01:01:16.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14832024-12-07T01:01:16.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14842024-12-07T01:01:16.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14852024-12-07T01:01:16.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14862024-12-07T01:01:16.796ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
14872024-12-07T01:01:16.796ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
14882024-12-07T01:01:16.796ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
14892024-12-07T01:01:16.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14902024-12-07T01:01:16.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14912024-12-07T01:01:16.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14922024-12-07T01:01:16.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14932024-12-07T01:01:16.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14942024-12-07T01:01:16.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14952024-12-07T01:01:16.800ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14962024-12-07T01:01:16.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14972024-12-07T01:01:16.803ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14982024-12-07T01:01:16.803ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14992024-12-07T01:01:16.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15002024-12-07T01:01:16.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15012024-12-07T01:01:16.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15022024-12-07T01:01:16.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15032024-12-07T01:01:16.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15042024-12-07T01:01:16.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4540, tv_nsec: 30295670 } })
15052024-12-07T01:01:16.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
15062024-12-07T01:01:16.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15072024-12-07T01:01:16.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15082024-12-07T01:01:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15092024-12-07T01:01:16.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15102024-12-07T01:01:16.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15112024-12-07T01:01:16.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
15122024-12-07T01:01:16.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15132024-12-07T01:01:16.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15142024-12-07T01:01:16.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15152024-12-07T01:01:16.814ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15162024-12-07T01:01:16.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15172024-12-07T01:01:16.825ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15182024-12-07T01:01:16.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15192024-12-07T01:01:16.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.617685ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15202024-12-07T01:01:16.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15212024-12-07T01:01:16.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15222024-12-07T01:01:16.829ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15232024-12-07T01:01:16.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15242024-12-07T01:01:16.829ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
15252024-12-07T01:01:16.829ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.744557ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
15262024-12-07T01:01:16.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15272024-12-07T01:01:16.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.566353ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15282024-12-07T01:01:16.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15292024-12-07T01:01:16.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15302024-12-07T01:01:16.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.789758ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
15312024-12-07T01:01:16.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15322024-12-07T01:01:16.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.818818ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15332024-12-07T01:01:16.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15342024-12-07T01:01:16.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3, lookup_type: ById(e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) } result = Ok(())
15352024-12-07T01:01:16.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15362024-12-07T01:01:16.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15372024-12-07T01:01:16.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15382024-12-07T01:01:16.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15392024-12-07T01:01:16.837ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.738615ms iteration = 27 status = 0
15402024-12-07T01:01:16.838ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15412024-12-07T01:01:16.838ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15422024-12-07T01:01:16.838ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.793006ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15432024-12-07T01:01:16.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15442024-12-07T01:01:16.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15452024-12-07T01:01:16.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15462024-12-07T01:01:16.841ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15472024-12-07T01:01:16.841ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15482024-12-07T01:01:16.841ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.284284ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15492024-12-07T01:01:16.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15502024-12-07T01:01:16.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15512024-12-07T01:01:16.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15522024-12-07T01:01:16.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15532024-12-07T01:01:16.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15542024-12-07T01:01:16.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15552024-12-07T01:01:16.844ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15562024-12-07T01:01:16.844ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15572024-12-07T01:01:16.844ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15582024-12-07T01:01:16.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15592024-12-07T01:01:16.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15602024-12-07T01:01:16.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15612024-12-07T01:01:16.846ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15622024-12-07T01:01:16.846ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ae6d4ace-ffdd-4139-9e11-1794ae966042 dns_zone_name = oxide.test found_so_far = 0 version = 2
15632024-12-07T01:01:16.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15642024-12-07T01:01:16.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15652024-12-07T01:01:16.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15662024-12-07T01:01:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15672024-12-07T01:01:16.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15682024-12-07T01:01:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15692024-12-07T01:01:16.849ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15702024-12-07T01:01:16.849ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.564047ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15712024-12-07T01:01:16.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15722024-12-07T01:01:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15732024-12-07T01:01:16.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15742024-12-07T01:01:16.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15752024-12-07T01:01:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15762024-12-07T01:01:16.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15772024-12-07T01:01:16.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15782024-12-07T01:01:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15792024-12-07T01:01:16.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.178093ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15802024-12-07T01:01:16.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15812024-12-07T01:01:16.893ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15822024-12-07T01:01:16.893ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 52ba8747-d0f6-43d9-9ec0-995aa6df639a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15832024-12-07T01:01:16.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15842024-12-07T01:01:16.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15852024-12-07T01:01:16.894ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15862024-12-07T01:01:16.894ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15872024-12-07T01:01:16.894ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae60adb8-1f73-4b90-af46-496b869ac16b", "content-length": "26", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} })
15882024-12-07T01:01:16.894ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15892024-12-07T01:01:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15902024-12-07T01:01:16.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15912024-12-07T01:01:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15922024-12-07T01:01:16.896ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.888671ms iteration = 31 status = {"physical_disks_added":0}
15932024-12-07T01:01:16.897ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15942024-12-07T01:01:16.904ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-07T00:48:09.490271Z, time_modified: 2024-12-07T00:48:09.490271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 3a67a720-d4af-42e7-875a-3abed4955db5, db_silo: Silo { identity: SiloIdentity { id: 3a67a720-d4af-42e7-875a-3abed4955db5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-07T00:48:45.569718Z, time_modified: 2024-12-07T00:48:45.569718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6317ba4eb1538be6191eb18b3b3531d70dbee51545c790c2aff24b81494c24f4" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 3a67a720-d4af-42e7-875a-3abed4955db5, db_silo: Silo { identity: SiloIdentity { id: 3a67a720-d4af-42e7-875a-3abed4955db5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-07T00:48:45.569718Z, time_modified: 2024-12-07T00:48:45.569718Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6317ba4eb1538be6191eb18b3b3531d70dbee51545c790c2aff24b81494c24f4" }] }) }
15952024-12-07T01:01:16.904ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 138.96618ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"3a67a720-d4af-42e7-875a-3abed4955db5","tls_certs":["6317ba4eb1538be6191eb18b3b3531d70dbee51545c790c2aff24b81494c24f4"]}},"default_endpoint":{"silo_id":"3a67a720-d4af-42e7-875a-3abed4955db5","tls_certs":["6317ba4eb1538be6191eb18b3b3531d70dbee51545c790c2aff24b81494c24f4"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15962024-12-07T01:01:16.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15972024-12-07T01:01:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15982024-12-07T01:01:16.916ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15992024-12-07T01:01:16.920ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16002024-12-07T01:01:16.924ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16012024-12-07T01:01:16.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 158.24159ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16022024-12-07T01:01:16.930ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16032024-12-07T01:01:16.930ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16042024-12-07T01:01:16.931ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fafbdad2-7645-4177-a349-de1ea9dc434b", "content-length": "26", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} })
16052024-12-07T01:01:16.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16062024-12-07T01:01:16.932ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16072024-12-07T01:01:16.980ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a zone_address = fd00:1122:3344:101::2
16082024-12-07T01:01:16.980ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16092024-12-07T01:01:16.980ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37286daf-678f-4e21-ba79-e791d9621345", "content-length": "26", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} })
16102024-12-07T01:01:16.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16112024-12-07T01:01:16.982ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
16122024-12-07T01:01:17.043ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16132024-12-07T01:01:17.043ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16142024-12-07T01:01:17.044ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad474649-971a-4f9b-9885-6273603de50a", "content-length": "372", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} })
16152024-12-07T01:01:17.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16162024-12-07T01:01:17.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16172024-12-07T01:01:17.046ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ae6d4ace-ffdd-4139-9e11-1794ae966042 dns_zone_name = oxide.test found_so_far = 1 version = 2
16182024-12-07T01:01:17.046ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16192024-12-07T01:01:17.046ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-07 00:48:45.853224 UTC dns_group = external generation = 2
16202024-12-07T01:01:17.046ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 280.750006ms iteration = 15 status = {"generation":2}
16212024-12-07T01:01:17.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16222024-12-07T01:01:17.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16232024-12-07T01:01:17.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16242024-12-07T01:01:17.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16252024-12-07T01:01:17.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16262024-12-07T01:01:17.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16272024-12-07T01:01:17.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16282024-12-07T01:01:17.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16292024-12-07T01:01:17.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16302024-12-07T01:01:17.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16312024-12-07T01:01:17.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16322024-12-07T01:01:17.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16332024-12-07T01:01:17.078ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16342024-12-07T01:01:17.078ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2d81ee2-5472-40ed-8a4e-cf379d6e7f81", "content-length": "2", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} })
16352024-12-07T01:01:17.079ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 52ba8747-d0f6-43d9-9ec0-995aa6df639a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16362024-12-07T01:01:17.079ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16372024-12-07T01:01:17.079ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-07 00:48:44.409012 UTC dns_group = internal generation = 1
16382024-12-07T01:01:17.079ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 314.328918ms iteration = 15 status = {"generation":1}
16392024-12-07T01:01:17.080ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16402024-12-07T01:01:17.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16412024-12-07T01:01:17.082ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 317.422599ms iteration = 27 status = null
16422024-12-07T01:01:17.095ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16432024-12-07T01:01:17.101ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16442024-12-07T01:01:17.101ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16452024-12-07T01:01:17.101ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "85cfe773-42fe-4651-8fa5-f91e3558a689", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} })
16462024-12-07T01:01:17.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16472024-12-07T01:01:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16482024-12-07T01:01:17.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16492024-12-07T01:01:17.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16502024-12-07T01:01:17.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16512024-12-07T01:01:17.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16522024-12-07T01:01:17.110ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16532024-12-07T01:01:17.110ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16542024-12-07T01:01:17.110ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b0797c5e-253c-4cda-b436-85d20577f7e9", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} })
16552024-12-07T01:01:17.112ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 346.208397ms iteration = 29 status = {}
16562024-12-07T01:01:17.185ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = cca64b6e-091f-4dc5-a9e5-6bdfe07f8506 response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
16572024-12-07T01:01:17.208ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16582024-12-07T01:01:17.209ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1725ada9-939e-4ec5-98d4-eae77f563e82", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16592024-12-07T01:01:17.209ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16602024-12-07T01:01:17.210ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1ceabbfd-1a37-4f7f-9700-111a1b52ae97", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16612024-12-07T01:01:17.210ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16622024-12-07T01:01:17.212ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16632024-12-07T01:01:17.212ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 446.75952ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16642024-12-07T01:01:17.220ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 455.068513ms iteration = 27 status = {}
16652024-12-07T01:01:17.234ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16662024-12-07T01:01:17.235ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0f13bc2e-be2b-45fb-88fe-d0d70162d343", "date": "Sat, 07 Dec 2024 01:01:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16672024-12-07T01:01:17.235ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16682024-12-07T01:01:17.236ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3527ddf7-a2ab-45f6-b1c2-b074b9d10f8a", "date": "Sat, 07 Dec 2024 01:01:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16692024-12-07T01:01:17.236ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16702024-12-07T01:01:17.238ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "de830316-c1ec-4b2f-9ba7-9dcfd7946194", "date": "Sat, 07 Dec 2024 01:01:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16712024-12-07T01:01:17.238ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16722024-12-07T01:01:17.240ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16732024-12-07T01:01:17.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 474.610848ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16742024-12-07T01:01:17.242ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16752024-12-07T01:01:17.242ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "37fde1a7-91d6-43e5-8a50-099b4633ee95", "content-length": "691", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} })
16762024-12-07T01:01:17.242ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16772024-12-07T01:01:17.242ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16782024-12-07T01:01:17.242ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16792024-12-07T01:01:17.243ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 477.569877ms iteration = 28 status = {}
16802024-12-07T01:01:17.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16812024-12-07T01:01:17.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16822024-12-07T01:01:17.285ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68b8f65f-54d5-4192-ac26-facf91340245, rack_id: 667e4910-296b-4cf9-a580-7c638e7aa45a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e642095a-6c9c-4557-b65a-98313f61cfeb) } rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0
16832024-12-07T01:01:17.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16842024-12-07T01:01:17.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16852024-12-07T01:01:17.295ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16862024-12-07T01:01:17.295ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b861dd9-ecbe-4f76-ae66-24ac4a4efb39", "content-length": "134", "date": "Sat, 07 Dec 2024 01:01:17 GMT"} })
16872024-12-07T01:01:17.295ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16882024-12-07T01:01:17.295ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e642095a-6c9c-4557-b65a-98313f61cfeb
16892024-12-07T01:01:17.295ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16902024-12-07T01:01:17.295ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16912024-12-07T01:01:17.295ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16922024-12-07T01:01:17.295ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16932024-12-07T01:01:17.295ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16942024-12-07T01:01:17.295ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16952024-12-07T01:01:17.296ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16962024-12-07T01:01:17.296ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16972024-12-07T01:01:17.296ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
16982024-12-07T01:01:17.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16992024-12-07T01:01:17.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17002024-12-07T01:01:17.297ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17012024-12-07T01:01:17.298ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "321a75d6-cf83-4450-b679-14b44187ade5", "content-length": "2", "date": "Sat, 07 Dec 2024 01:01:17 GMT"} })
17022024-12-07T01:01:17.298ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17032024-12-07T01:01:17.298ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad0c42a9-0a8e-43fd-9ca3-4d20d85c9571", "content-length": "52", "date": "Sat, 07 Dec 2024 01:01:17 GMT"} })
17042024-12-07T01:01:17.298ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0
17052024-12-07T01:01:17.298ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17062024-12-07T01:01:17.397ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c4cf6cd5-39c5-4561-86c0-cfb0a2c29922", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} })
17072024-12-07T01:01:17.397ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch = Switch0
17082024-12-07T01:01:17.397ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17092024-12-07T01:01:17.397ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d5ed305-1aa2-4ca8-9685-861a7c436a6e", "content-length": "682", "date": "Sat, 07 Dec 2024 01:01:16 GMT"} })
17102024-12-07T01:01:17.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17112024-12-07T01:01:17.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17122024-12-07T01:01:17.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17132024-12-07T01:01:17.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17142024-12-07T01:01:17.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17152024-12-07T01:01:17.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17162024-12-07T01:01:17.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17172024-12-07T01:01:17.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17182024-12-07T01:01:17.415ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 649.061129ms iteration = 27 status = {}
17192024-12-07T01:01:17.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 5eb4eb9b-6bc7-4297-920c-1b5db838fbbf roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17202024-12-07T01:01:17.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 5eb4eb9b-6bc7-4297-920c-1b5db838fbbf resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17212024-12-07T01:01:17.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 5eb4eb9b-6bc7-4297-920c-1b5db838fbbf response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17222024-12-07T01:01:18.225ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
17232024-12-07T01:01:18.225ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
17242024-12-07T01:01:18.255ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
17252024-12-07T01:01:18.255ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:41571
17262024-12-07T01:01:18.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41571 req_id = 12ca49f2-e470-400d-9427-ba040d523056 roles = RoleSet { roles: {} } uri = /metrics/producers
17272024-12-07T01:01:18.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41571 req_id = 12ca49f2-e470-400d-9427-ba040d523056 resource = Database result = Ok(()) uri = /metrics/producers
17282024-12-07T01:01:18.291ZINFOnexus: assigned collector to new producer collector_id = 0c426bb3-2016-46d9-ae49-782d763f4e64 file = nexus/src/app/oximeter.rs:76 producer_id = 00ea6ad0-de1a-4101-a100-38e35668045b
17292024-12-07T01:01:18.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35761 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41571 req_id = 12ca49f2-e470-400d-9427-ba040d523056 response_code = 201 uri = /metrics/producers
17302024-12-07T01:01:18.291ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "12ca49f2-e470-400d-9427-ba040d523056", "content-length": "41", "date": "Sat, 07 Dec 2024 01:01:18 GMT"} })
17312024-12-07T01:01:18.293ZDEBGnexus (producer-registration-task): registered with nexus successfully
17322024-12-07T01:01:18.293ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
17332024-12-07T01:01:18.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 7852e90f-c258-49ea-a95b-46fcc964d86b roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17342024-12-07T01:01:18.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 7852e90f-c258-49ea-a95b-46fcc964d86b resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17352024-12-07T01:01:18.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 7852e90f-c258-49ea-a95b-46fcc964d86b response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17362024-12-07T01:01:19.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6e67968d-da4c-4950-b8d3-2fcbc2afb9a0 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17372024-12-07T01:01:19.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6e67968d-da4c-4950-b8d3-2fcbc2afb9a0 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17382024-12-07T01:01:19.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6e67968d-da4c-4950-b8d3-2fcbc2afb9a0 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17392024-12-07T01:01:20.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = bcdf6dd6-19d8-493f-8f02-8b85b39ea98a roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17402024-12-07T01:01:20.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = bcdf6dd6-19d8-493f-8f02-8b85b39ea98a resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17412024-12-07T01:01:20.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = bcdf6dd6-19d8-493f-8f02-8b85b39ea98a response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17422024-12-07T01:01:21.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 90a96bf1-6f09-4116-bd78-56dac0a65ab1 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17432024-12-07T01:01:21.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 90a96bf1-6f09-4116-bd78-56dac0a65ab1 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17442024-12-07T01:01:21.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 90a96bf1-6f09-4116-bd78-56dac0a65ab1 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17452024-12-07T01:01:22.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 3e57f243-215a-4ce2-9a1c-1855d4bc28e2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
17462024-12-07T01:01:22.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 3e57f243-215a-4ce2-9a1c-1855d4bc28e2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
17472024-12-07T01:01:22.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 3e57f243-215a-4ce2-9a1c-1855d4bc28e2 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
17482024-12-07T01:01:22.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = c6aa4c58-3556-4a43-af7a-097d75a2d59e roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17492024-12-07T01:01:22.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = c6aa4c58-3556-4a43-af7a-097d75a2d59e resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17502024-12-07T01:01:22.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = c6aa4c58-3556-4a43-af7a-097d75a2d59e response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17512024-12-07T01:01:23.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0d9aa685-686d-478c-a75c-6dad49199ee0 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17522024-12-07T01:01:23.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0d9aa685-686d-478c-a75c-6dad49199ee0 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17532024-12-07T01:01:23.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0d9aa685-686d-478c-a75c-6dad49199ee0 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17542024-12-07T01:01:24.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = c6d25e57-e705-4999-8cb7-f555f265ad1e roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17552024-12-07T01:01:24.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = c6d25e57-e705-4999-8cb7-f555f265ad1e resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17562024-12-07T01:01:24.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = c6d25e57-e705-4999-8cb7-f555f265ad1e response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17572024-12-07T01:01:25.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2cfd0ba0-cd7a-4211-83a4-b23a2321418c roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17582024-12-07T01:01:25.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2cfd0ba0-cd7a-4211-83a4-b23a2321418c resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17592024-12-07T01:01:25.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2cfd0ba0-cd7a-4211-83a4-b23a2321418c response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17602024-12-07T01:01:26.765ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
17612024-12-07T01:01:26.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17622024-12-07T01:01:26.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17632024-12-07T01:01:26.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
17642024-12-07T01:01:26.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17652024-12-07T01:01:26.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17662024-12-07T01:01:26.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17672024-12-07T01:01:26.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17682024-12-07T01:01:26.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17692024-12-07T01:01:26.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17702024-12-07T01:01:26.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17712024-12-07T01:01:26.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17722024-12-07T01:01:26.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17732024-12-07T01:01:26.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17742024-12-07T01:01:26.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17752024-12-07T01:01:26.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
17762024-12-07T01:01:26.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17772024-12-07T01:01:26.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17782024-12-07T01:01:26.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
17792024-12-07T01:01:26.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.808081ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
17802024-12-07T01:01:26.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.828779ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17812024-12-07T01:01:26.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 46f1e6c5-3e8b-45db-b56a-652c227fcc3b roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17822024-12-07T01:01:26.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 46f1e6c5-3e8b-45db-b56a-652c227fcc3b resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17832024-12-07T01:01:26.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 46f1e6c5-3e8b-45db-b56a-652c227fcc3b response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17842024-12-07T01:01:27.185ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1267 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = b0af2e4c-4dac-41fa-b10f-2ebca5070ef2 response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
17852024-12-07T01:01:27.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 7b959c78-af72-4629-9787-7549bebb6be5 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17862024-12-07T01:01:27.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 7b959c78-af72-4629-9787-7549bebb6be5 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17872024-12-07T01:01:27.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 7b959c78-af72-4629-9787-7549bebb6be5 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17882024-12-07T01:01:28.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 82da0843-8ae1-417a-9ea0-f0af6128e6b8 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17892024-12-07T01:01:28.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 82da0843-8ae1-417a-9ea0-f0af6128e6b8 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17902024-12-07T01:01:28.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 82da0843-8ae1-417a-9ea0-f0af6128e6b8 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17912024-12-07T01:01:29.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 71dddbba-7ae1-4819-8e9b-519cd58c5b1d roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17922024-12-07T01:01:29.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 71dddbba-7ae1-4819-8e9b-519cd58c5b1d resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17932024-12-07T01:01:29.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 71dddbba-7ae1-4819-8e9b-519cd58c5b1d response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17942024-12-07T01:01:30.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2609b367-337b-44e2-8a98-0e0dec4a24ae roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17952024-12-07T01:01:30.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2609b367-337b-44e2-8a98-0e0dec4a24ae resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17962024-12-07T01:01:30.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 2609b367-337b-44e2-8a98-0e0dec4a24ae response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17972024-12-07T01:01:31.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 998941e0-2f1a-4175-b981-5b7fc72f8d4b roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17982024-12-07T01:01:31.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 998941e0-2f1a-4175-b981-5b7fc72f8d4b resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17992024-12-07T01:01:31.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 998941e0-2f1a-4175-b981-5b7fc72f8d4b response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18002024-12-07T01:01:32.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9dc2eb1f-c76a-457f-8f90-b04eb93df8e2 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18012024-12-07T01:01:32.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9dc2eb1f-c76a-457f-8f90-b04eb93df8e2 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18022024-12-07T01:01:32.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 9dc2eb1f-c76a-457f-8f90-b04eb93df8e2 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18032024-12-07T01:01:33.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = cd05cf55-49f8-42c2-b255-2fb335a3e517 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18042024-12-07T01:01:33.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = cd05cf55-49f8-42c2-b255-2fb335a3e517 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18052024-12-07T01:01:33.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = cd05cf55-49f8-42c2-b255-2fb335a3e517 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18062024-12-07T01:01:35.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6753c00d-3441-4cb0-93ea-b8dcdf4bd34d roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18072024-12-07T01:01:35.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6753c00d-3441-4cb0-93ea-b8dcdf4bd34d resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18082024-12-07T01:01:35.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6753c00d-3441-4cb0-93ea-b8dcdf4bd34d response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18092024-12-07T01:01:36.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8de0cb98-1c40-41ba-b3b2-68be397e2805 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18102024-12-07T01:01:36.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8de0cb98-1c40-41ba-b3b2-68be397e2805 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18112024-12-07T01:01:36.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 8de0cb98-1c40-41ba-b3b2-68be397e2805 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18122024-12-07T01:01:36.765ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
18132024-12-07T01:01:36.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18142024-12-07T01:01:36.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18152024-12-07T01:01:36.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
18162024-12-07T01:01:36.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18172024-12-07T01:01:36.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18182024-12-07T01:01:36.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18192024-12-07T01:01:36.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18202024-12-07T01:01:36.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18212024-12-07T01:01:36.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18222024-12-07T01:01:36.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18232024-12-07T01:01:36.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18242024-12-07T01:01:36.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18252024-12-07T01:01:36.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18262024-12-07T01:01:36.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18272024-12-07T01:01:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
18282024-12-07T01:01:36.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18292024-12-07T01:01:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18302024-12-07T01:01:36.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
18312024-12-07T01:01:36.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.573746ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
18322024-12-07T01:01:36.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.513773ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18332024-12-07T01:01:37.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 42c9961e-96f3-4be9-b50f-862816f4f11b roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18342024-12-07T01:01:37.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 42c9961e-96f3-4be9-b50f-862816f4f11b resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18352024-12-07T01:01:37.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 42c9961e-96f3-4be9-b50f-862816f4f11b response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18362024-12-07T01:01:37.185ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = 16781936-609a-4e73-ba82-5bc6955bb1db response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
18372024-12-07T01:01:38.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6c61cda7-2109-4e6a-9788-22fb2dc7a511 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18382024-12-07T01:01:38.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6c61cda7-2109-4e6a-9788-22fb2dc7a511 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18392024-12-07T01:01:38.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 6c61cda7-2109-4e6a-9788-22fb2dc7a511 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18402024-12-07T01:01:39.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 43b3ca84-8c4f-4229-843d-be82941116d8 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18412024-12-07T01:01:39.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 43b3ca84-8c4f-4229-843d-be82941116d8 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18422024-12-07T01:01:39.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 43b3ca84-8c4f-4229-843d-be82941116d8 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18432024-12-07T01:01:40.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = cc33a176-e980-4c2e-bced-4cc63534f55c roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18442024-12-07T01:01:40.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = cc33a176-e980-4c2e-bced-4cc63534f55c resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18452024-12-07T01:01:40.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = cc33a176-e980-4c2e-bced-4cc63534f55c response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18462024-12-07T01:01:41.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = b00db5d1-3d46-43f5-9c13-9fd30405ec07 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18472024-12-07T01:01:41.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = b00db5d1-3d46-43f5-9c13-9fd30405ec07 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18482024-12-07T01:01:41.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = b00db5d1-3d46-43f5-9c13-9fd30405ec07 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18492024-12-07T01:01:42.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 10811bec-3d8a-4106-8c51-f33bbd613c00 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18502024-12-07T01:01:42.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 10811bec-3d8a-4106-8c51-f33bbd613c00 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18512024-12-07T01:01:42.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 10811bec-3d8a-4106-8c51-f33bbd613c00 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18522024-12-07T01:01:43.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 7cde8b85-80b9-44ac-99b5-0a231f43c8aa roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18532024-12-07T01:01:43.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 7cde8b85-80b9-44ac-99b5-0a231f43c8aa resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18542024-12-07T01:01:43.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 7cde8b85-80b9-44ac-99b5-0a231f43c8aa response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18552024-12-07T01:01:44.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 925bba00-052f-4fb9-afac-c47fb8bd12cf roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18562024-12-07T01:01:44.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 925bba00-052f-4fb9-afac-c47fb8bd12cf resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18572024-12-07T01:01:44.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 925bba00-052f-4fb9-afac-c47fb8bd12cf response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18582024-12-07T01:01:45.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a563ea9a-fbd4-443c-b7ab-da83d49935ba roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18592024-12-07T01:01:45.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a563ea9a-fbd4-443c-b7ab-da83d49935ba resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18602024-12-07T01:01:45.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = a563ea9a-fbd4-443c-b7ab-da83d49935ba response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18612024-12-07T01:01:46.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3d70c504-f36e-4b34-9277-c7f5e7428188 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18622024-12-07T01:01:46.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3d70c504-f36e-4b34-9277-c7f5e7428188 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18632024-12-07T01:01:46.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 3d70c504-f36e-4b34-9277-c7f5e7428188 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18642024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
18652024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18662024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
18672024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
18682024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18692024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
18702024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
18712024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18722024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18732024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18742024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18752024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18762024-12-07T01:01:46.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18772024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
18782024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
18792024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18802024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18812024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18822024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
18832024-12-07T01:01:46.766ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18842024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18852024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
18862024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18872024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
18882024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
18892024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18902024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
18912024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18922024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18932024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
18942024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18952024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
18962024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18972024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18982024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18992024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19002024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19012024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19022024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19032024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19042024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19052024-12-07T01:01:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19062024-12-07T01:01:46.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19072024-12-07T01:01:46.768ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
19082024-12-07T01:01:46.768ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
19092024-12-07T01:01:46.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19102024-12-07T01:01:46.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19112024-12-07T01:01:46.768ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
19122024-12-07T01:01:46.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19132024-12-07T01:01:46.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19142024-12-07T01:01:46.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19152024-12-07T01:01:46.768ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4569, tv_nsec: 994137201 } })
19162024-12-07T01:01:46.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19172024-12-07T01:01:46.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182024-12-07T01:01:46.769ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
19192024-12-07T01:01:46.769ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4569, tv_nsec: 994575870 } })
19202024-12-07T01:01:46.769ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.380326ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19212024-12-07T01:01:46.769ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
19222024-12-07T01:01:46.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19232024-12-07T01:01:46.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19242024-12-07T01:01:46.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19252024-12-07T01:01:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19262024-12-07T01:01:46.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19272024-12-07T01:01:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19282024-12-07T01:01:46.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19292024-12-07T01:01:46.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19302024-12-07T01:01:46.777ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19312024-12-07T01:01:46.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19322024-12-07T01:01:46.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19332024-12-07T01:01:46.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19342024-12-07T01:01:46.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19352024-12-07T01:01:46.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19362024-12-07T01:01:46.809ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19372024-12-07T01:01:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19382024-12-07T01:01:46.812ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19392024-12-07T01:01:46.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19402024-12-07T01:01:46.815ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.047948ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
19412024-12-07T01:01:46.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19422024-12-07T01:01:46.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19432024-12-07T01:01:46.816ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19442024-12-07T01:01:46.816ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19452024-12-07T01:01:46.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19462024-12-07T01:01:46.816ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19472024-12-07T01:01:46.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19482024-12-07T01:01:46.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19492024-12-07T01:01:46.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19502024-12-07T01:01:46.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19512024-12-07T01:01:46.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19522024-12-07T01:01:46.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19532024-12-07T01:01:46.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19542024-12-07T01:01:46.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19552024-12-07T01:01:46.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19562024-12-07T01:01:46.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19572024-12-07T01:01:46.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19582024-12-07T01:01:46.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19592024-12-07T01:01:46.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19602024-12-07T01:01:46.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19612024-12-07T01:01:46.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19622024-12-07T01:01:46.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19632024-12-07T01:01:46.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19642024-12-07T01:01:46.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19652024-12-07T01:01:46.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19662024-12-07T01:01:46.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33cdb3e1-1067-4513-ae76-65cb52da1a70, lookup_type: ById(33cdb3e1-1067-4513-ae76-65cb52da1a70) } result = Ok(())
19672024-12-07T01:01:46.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19682024-12-07T01:01:46.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19692024-12-07T01:01:46.824ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4570, tv_nsec: 49367230 } })
19702024-12-07T01:01:46.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19712024-12-07T01:01:46.824ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
19722024-12-07T01:01:46.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19732024-12-07T01:01:46.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.031103ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
19742024-12-07T01:01:46.833ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19752024-12-07T01:01:46.833ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.259537ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19762024-12-07T01:01:46.836ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 original_time_created = 2024-12-07 00:48:03.718366 UTC target_id = 33cdb3e1-1067-4513-ae76-65cb52da1a70 time_created = 2024-12-07 00:48:03.718366 UTC
19772024-12-07T01:01:46.836ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.585382ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33cdb3e1-1067-4513-ae76-65cb52da1a70","time_created":"2024-12-07T00:48:03.718366Z"}
19782024-12-07T01:01:46.837ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19792024-12-07T01:01:46.837ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19802024-12-07T01:01:46.837ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc2ef0a7-5745-4671-afc9-8e9a4c3e8798", "content-length": "26", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
19812024-12-07T01:01:46.837ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19822024-12-07T01:01:46.842ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19832024-12-07T01:01:46.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.783003ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19842024-12-07T01:01:46.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19852024-12-07T01:01:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19862024-12-07T01:01:46.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.638008ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19872024-12-07T01:01:46.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19882024-12-07T01:01:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19892024-12-07T01:01:46.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19902024-12-07T01:01:46.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19912024-12-07T01:01:46.856ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19922024-12-07T01:01:46.856ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19932024-12-07T01:01:46.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19942024-12-07T01:01:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19952024-12-07T01:01:46.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19962024-12-07T01:01:46.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19972024-12-07T01:01:46.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19982024-12-07T01:01:46.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19992024-12-07T01:01:46.864ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20002024-12-07T01:01:46.864ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20012024-12-07T01:01:46.864ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dde45abf-bd3f-4ce3-b3f8-97010c96c725", "content-length": "26", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20022024-12-07T01:01:46.864ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20032024-12-07T01:01:46.866ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20042024-12-07T01:01:46.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.461349ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
20052024-12-07T01:01:46.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20062024-12-07T01:01:46.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20072024-12-07T01:01:46.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3, lookup_type: ById(e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) } result = Ok(())
20082024-12-07T01:01:46.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20092024-12-07T01:01:46.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20102024-12-07T01:01:46.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20112024-12-07T01:01:46.887ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20122024-12-07T01:01:46.887ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20132024-12-07T01:01:46.887ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.148079ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20142024-12-07T01:01:46.887ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.582107ms iteration = 28 status = 0
20152024-12-07T01:01:46.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.838653ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
20162024-12-07T01:01:46.929ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.928512ms iteration = 32 status = {"physical_disks_added":0}
20172024-12-07T01:01:46.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a zone_address = fd00:1122:3344:101::2
20182024-12-07T01:01:46.931ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20192024-12-07T01:01:46.931ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f8bccd6-bd6f-447c-8be1-16adff70ce35", "content-length": "26", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20202024-12-07T01:01:46.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20212024-12-07T01:01:46.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
20222024-12-07T01:01:46.936ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20232024-12-07T01:01:46.936ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc740ae4-d9fb-4c8a-8a55-ff457c983778", "content-length": "2", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20242024-12-07T01:01:46.938ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20252024-12-07T01:01:46.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20262024-12-07T01:01:46.950ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 185.259713ms iteration = 28 status = {}
20272024-12-07T01:01:46.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20282024-12-07T01:01:46.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20292024-12-07T01:01:46.987ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20302024-12-07T01:01:46.987ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20312024-12-07T01:01:46.988ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c7ec318-e1a4-4904-98b2-cbcc7e8ac58a", "content-length": "372", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20322024-12-07T01:01:46.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20332024-12-07T01:01:46.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20342024-12-07T01:01:46.989ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 224.797193ms iteration = 28 status = null
20352024-12-07T01:01:47.004ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20362024-12-07T01:01:47.004ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20372024-12-07T01:01:47.005ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "15670e98-56db-4ab1-986e-ecd63320b06a", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20382024-12-07T01:01:47.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20392024-12-07T01:01:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20402024-12-07T01:01:47.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20412024-12-07T01:01:47.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20422024-12-07T01:01:47.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20432024-12-07T01:01:47.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20442024-12-07T01:01:47.014ZINFOnexus (BackgroundTasks): VPC route manager sled e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20452024-12-07T01:01:47.014ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20462024-12-07T01:01:47.015ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "687ad93f-ec83-4cd6-869c-a2369855d82e", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20472024-12-07T01:01:47.017ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 251.459129ms iteration = 30 status = {}
20482024-12-07T01:01:47.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20492024-12-07T01:01:47.026ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20502024-12-07T01:01:47.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20512024-12-07T01:01:47.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20522024-12-07T01:01:47.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20532024-12-07T01:01:47.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20542024-12-07T01:01:47.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20552024-12-07T01:01:47.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20562024-12-07T01:01:47.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20572024-12-07T01:01:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20582024-12-07T01:01:47.063ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68b8f65f-54d5-4192-ac26-facf91340245, rack_id: 667e4910-296b-4cf9-a580-7c638e7aa45a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e642095a-6c9c-4557-b65a-98313f61cfeb) } rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0
20592024-12-07T01:01:47.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20602024-12-07T01:01:47.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20612024-12-07T01:01:47.073ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20622024-12-07T01:01:47.073ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "41a30268-cb00-4405-a78a-39ea8239d190", "content-length": "134", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20632024-12-07T01:01:47.073ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20642024-12-07T01:01:47.073ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e642095a-6c9c-4557-b65a-98313f61cfeb
20652024-12-07T01:01:47.073ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20662024-12-07T01:01:47.073ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20672024-12-07T01:01:47.073ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20682024-12-07T01:01:47.073ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20692024-12-07T01:01:47.073ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20702024-12-07T01:01:47.073ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20712024-12-07T01:01:47.073ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20722024-12-07T01:01:47.073ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20732024-12-07T01:01:47.074ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a
20742024-12-07T01:01:47.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20752024-12-07T01:01:47.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20762024-12-07T01:01:47.075ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20772024-12-07T01:01:47.076ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcf7bc07-2389-4658-8e73-cc76671cdd23", "content-length": "2", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20782024-12-07T01:01:47.076ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20792024-12-07T01:01:47.076ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "975ed9fa-159e-421c-9d8a-432581b51bfc", "content-length": "52", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20802024-12-07T01:01:47.076ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch_location = Switch0
20812024-12-07T01:01:47.076ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20822024-12-07T01:01:47.119ZDEBGnexus (BackgroundTasks): client request SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20832024-12-07T01:01:47.183ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c841ca01-f977-4bee-982f-b917bd2b56e8", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20842024-12-07T01:01:47.183ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a switch = Switch0
20852024-12-07T01:01:47.183ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20862024-12-07T01:01:47.183ZDEBGnexus (BackgroundTasks): client response SledAgent = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0747944d-d4cf-4e41-897a-139ba5733546", "content-length": "691", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20872024-12-07T01:01:47.183ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20882024-12-07T01:01:47.183ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20892024-12-07T01:01:47.183ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20902024-12-07T01:01:47.183ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 667e4910-296b-4cf9-a580-7c638e7aa45a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "30fcbbdc-9a7d-4dc5-b3d6-40e048b576d6", "content-length": "682", "date": "Sat, 07 Dec 2024 01:01:46 GMT"} })
20912024-12-07T01:01:47.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20922024-12-07T01:01:47.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20932024-12-07T01:01:47.185ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 418.991152ms iteration = 29 status = {}
20942024-12-07T01:01:47.185ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1371 local_addr = [fd00:1122:3344:101::c]:37092 method = GET remote_addr = [fd00:1122:3344:101::d]:33988 req_id = cdccbfe9-2c5c-486e-aee4-063f26e2289f response_code = 200 uri = /00ea6ad0-de1a-4101-a100-38e35668045b
20952024-12-07T01:01:47.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20962024-12-07T01:01:47.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20972024-12-07T01:01:47.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20982024-12-07T01:01:47.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20992024-12-07T01:01:47.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21002024-12-07T01:01:47.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21012024-12-07T01:01:47.201ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 435.557709ms iteration = 28 status = {}
21022024-12-07T01:01:47.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = d5fc2838-9d62-450c-8743-b76629a1bcd7 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21032024-12-07T01:01:47.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = d5fc2838-9d62-450c-8743-b76629a1bcd7 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21042024-12-07T01:01:47.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = d5fc2838-9d62-450c-8743-b76629a1bcd7 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21052024-12-07T01:01:48.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 41a6f37d-8bb5-4471-aa7f-35abce5820ef roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21062024-12-07T01:01:48.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 41a6f37d-8bb5-4471-aa7f-35abce5820ef resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21072024-12-07T01:01:48.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 41a6f37d-8bb5-4471-aa7f-35abce5820ef response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21082024-12-07T01:01:49.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 32f5f013-0500-425c-8117-a52526c16559 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21092024-12-07T01:01:49.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 32f5f013-0500-425c-8117-a52526c16559 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21102024-12-07T01:01:49.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 32f5f013-0500-425c-8117-a52526c16559 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21112024-12-07T01:01:50.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 436d845f-f8f9-4842-8761-a17a69c6674b roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21122024-12-07T01:01:50.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 436d845f-f8f9-4842-8761-a17a69c6674b resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21132024-12-07T01:01:50.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 436d845f-f8f9-4842-8761-a17a69c6674b response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21142024-12-07T01:01:51.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = f9203ad3-af03-40d4-80c7-8b3dfd50dcfc roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21152024-12-07T01:01:51.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = f9203ad3-af03-40d4-80c7-8b3dfd50dcfc resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21162024-12-07T01:01:51.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = f9203ad3-af03-40d4-80c7-8b3dfd50dcfc response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21172024-12-07T01:01:52.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0c7ba1b8-9860-4b0e-8041-fdc0713b63b5 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21182024-12-07T01:01:52.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0c7ba1b8-9860-4b0e-8041-fdc0713b63b5 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21192024-12-07T01:01:52.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 0c7ba1b8-9860-4b0e-8041-fdc0713b63b5 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21202024-12-07T01:01:52.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 73f9ae01-de35-4014-aa51-e01b12b71905 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
21212024-12-07T01:01:52.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 73f9ae01-de35-4014-aa51-e01b12b71905 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
21222024-12-07T01:01:52.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:34347 req_id = 73f9ae01-de35-4014-aa51-e01b12b71905 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
21232024-12-07T01:01:53.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 34d2514f-9f6f-46d0-af58-dd944b862af2 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21242024-12-07T01:01:53.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 34d2514f-9f6f-46d0-af58-dd944b862af2 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21252024-12-07T01:01:53.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 34d2514f-9f6f-46d0-af58-dd944b862af2 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21262024-12-07T01:01:54.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 48b89415-bfe0-4ccf-8aea-b8f54737dd5a roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21272024-12-07T01:01:54.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 48b89415-bfe0-4ccf-8aea-b8f54737dd5a resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21282024-12-07T01:01:54.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = 48b89415-bfe0-4ccf-8aea-b8f54737dd5a response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21292024-12-07T01:01:55.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = d3036c2c-0a5f-48bd-a4ca-cbe91052eb99 roles = RoleSet { roles: {} } uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21302024-12-07T01:01:55.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = d3036c2c-0a5f-48bd-a4ca-cbe91052eb99 resource = Database result = Ok(()) uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21312024-12-07T01:01:55.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58522 req_id = d3036c2c-0a5f-48bd-a4ca-cbe91052eb99 response_code = 200 uri = /probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3